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FOREWORD 


The  U.S.  Army  Research  Institute  conducts  research  and  development  in  edu¬ 
cational  technology  with  applicability  to  military  education  and  training.  Of 
special  interest  is  research  in  the  application  of  computer  technology.  The 
development  and  implementation  of  computer-based  systems  is  seen  as  a  solution 
to  current  Army  problems  such  as  the  management  of  career  and  educational  in¬ 
formation  available  to  soldiers. 

This  report  reviews  the  development  and  field  test  of  one  such  sy$tem--the 
Army  Education  Information  System  (AREIS).  This  computer-based  tool  to  aid 
Education  Center  Counselors  is  designed  to  enable  soldiers  to  assess  their  in¬ 
dividual  career  interests.  The  field  test  of  AREIS  indicated  that  the  AREIS 
courseware  and  software  operated  as  designed  and  soldiers  were  favorable  toward 
the  value  of  the  system. 


EDGAR  M.  JOHNSON 


Technical  Director 
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THE  EVALUATION  OF  THE  ARMY  EDUCATION  INFORMATION  SYSTEM 


EXECUTIVE  SUMMARY 


Requirement: 

To  develop  a  computer-based  Army  career  and  educational  guidance  system 
in  order  to  reduce  the  routine  information  dispensing  tasks  of  Education  Center 
Counselors  and  to  aid  soldiers  in  making  decisions  about  their  careers. 


Procedure: 

The  Army  Education  Information  System  (AREIS)  is  composed  of  courseware 
which  enables  soldiers  to  assess  their  individual  career  interests,  values, 
and  aptitudes.  The  AREIS  provides  online  administration  and  interpretation 
of  three  self-assessment  devices  used  in  civilian  career  guidance  that  help 
the  soldier  broaden  or  narrow  his  career  choices.  Using  the  assessment  pro¬ 
file,  system  software  can  generate  a  list  of  appropriate  career  choices  by 
matching  the  soldier's  responses  to  a  database  of  over  400  civilian  jobs  and 
their  corresponding  military  occupational  specialty  (MOS).  AREIS  also  provides 
information  on  local  educational  and  training  course  offerings.  This  system 
was  evaluated  for  a  9-month  period  at  three  Army  sites.  Fort  Gordon,  Georgia; 
Fort  Meade,  Maryland;  and  Mannheim,  Germany,  in  a  multi-user  microcomputer 
environment. 


Findings: 

The  majority  of  the  AREIS  courseware  and  software  operates  as  designed. 
Soldiers  expressed  positive  attitudes  about  the  value  of  the  AREIS  informa¬ 
tion.  Difficulties  with  the  hardware  were  observed  at  the  three  test  sites. 


Utilization  of  Findings: 

AREIS  is  being  considered  for  implementation  by  the  Defense  Activity  for 
Non-Traditional  Education  Support. 
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THE  EVALUATION  OF  THE  ARMY  EDUCATION  INFORMATION  SYSTEM 


INTRODUCTION 

Army  Education  Center  Counselors  spend  many  hundreds  of  hours  each  year 
providing  soldiers  with  career  and  educational  Information.  This  Information 
Is  extensive,  complex,  often  routine,  and  subject  to  change  at  any  time  due  to 
the  dynamic  nature  of  Army  regulations.  At  a  time  when  career  and  educational 
options  are  prol I feratlng  and  the  volume  of  data  relating  to  these  options  Is 
Increasing,  the  number  of  Army  Education  Center  Counselors  Is  decreasing. 
Hence,  It  Is  Important  to  develop  a  mode  of  delivery  which  will  rapidly  and 
accurately  dispense  routine  career  and  educational  Information  to  soldiers  so 
that  Counselors  can  engage  In  the  activities  tor  which  they  were  trained: 
counseling  and  consultation. 

The  Army  Education  Information  System  ( ARE l S )  was  designed  to  support  the 
requirements  of  Army  Education  Center  Counselors.  This  document  will  review 
the  design  and  development  of  AREIS  and  focus  on  the  evaluation  of  the 
system.  This  effort  was  accomplished  In  two  phases  over  a  tour  year  period. 
The  first  phase  covered  the  administration  of  a  Needs  Assessment  and  the 
development  of  preliminary  specifications  for  AREIS.  An  analysis  of  hardware 
options  was  also  produced.  During  the  second  phase  the  specifications  were 
refined  and  the  AREIS  courseware  and  software  were  produced  to  operate  In  a 
microcomputer  environment.  AREIS  was  evaluated  during  this  phase  at  three 
Army  sites. 
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THE  FIRST  PHASE 


In  1979,  the  Adjutant  General  Center,  Education  Directorate,  Department 
of  the  Army,  charged  the  U.S.  Army  Research  Institute  (ARI)  with  the  task  of 
developing  a  prototype  for  an  Interactive,  computer-based  system  which  would 
be  placed  In  Education  Centers  for  the  purpose  of  providing  serv 1 cemembers 
Information  about  military  and  civilian  career  and  educational 
opportun Itles.  ARI  contracted  with  DISCOVER/ American  College  Testing  Program 
to  assess  Education  Center  personnel -perce 1 ved  needs  and  to  develop  such  a 
prototype. 

A  world-wide  Needs  Assessment  was  conducted  to  determine  the  counseling 
activities  of  Education  Services  Officers  and  Education  Center  Counselors 
(Harr I s-Bow Isbey  and  Rabush,  1979).  The  Needs  Assessment  survey  also 
requested  Information  about  attitudes  towards  using  computers  In  the 
counseling  program.  The  following  conclusions  were  drawn  from  the  needs 
assessment: 

o  the  Counselor  caseload  averages  1600  soldiers  per  year 
o  Counselors  counsel  approximately  64$  of  their  assigned 
load  In  a  year 

o  each  Counselor  averages  2400  Interviews  per  year 
o  the  primary  delivery  mode  of  counseling  services  Is  the 
one-to-one  Interview  (52$) 

o  Counselors  provide  Information  on  approximately  twenty 
different  Army  Continuing  Education  System  (ACES)  programs 
o  Counselors  view  the  Infusion  of  a  computer-based  Information 
system  Into  the  Education  Center  as  positive,  both  for 
themselves  and  for  soldiers. 

The  Needs  Assessment  Identified  a  need  for  an  alternative  delivery  mode 
for  Information  about  the  ACES  programs.  It  also  Identified  the  kind  of 
Information  which  would  be  the  most  useful  to  Counselors  and  soldiers.  As  a 
result  of  the  Needs  Assessment,  the  following  design  requirements  were 
I  dent  I f I ed : 
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The  computer-based  system  should  contain  two  Interacting  parts: 
a)  a  series  of  concise  Interactive,  personalized  Instruction 
and  guidance  scripts  for  use  by  soldiers,  and  b)  a  set  of  direct 
access  functions  which  would  call  up  Information  found  In  the 
soldier  subsystems. 

The  design  requirements  were  used  to  conceptualize  the  four  subsystems  of 
AREIS.  Three  subsystems,  designed  for  use  by  soldiers.  Included: 

Subsystem  1:  ORIENTATION,  containing  an  overview  of  AREIS  content 
and  operation  and  an  Introduction  to  the  services  of 
the  Education  Center  and  to  the  ACES  programs. 

Subsystem  2:  SELF-1 NFORMATION,  containing  three  on-line  assessment 
devices  related  to  Interests,  abilities,  and  work- 
related  values. 

Subsystem  3:  GOALS  AND  PLANNING,  containing  several  parts  related 
to  military  and  civilian  career  and  education  goals. 

The  fourth  subsystem,  the  COUNSELOR/ADMINISTER  Subsystem,  was  designed  for  use 

by  Education  Center  staff  only.  Here  Counselors  could  access  the  Education 

Record  Form  669,  could  build  a  database  pertaining  to  the  activities  and 

services  of  their  specific  center  and  post,  and  could  access  the  database 

which  supported  the  soldier  subsystems  (e.g..  Army  Military  Occupational 

Specialties  (MOS's)  and  civilian  occupations). 

Selected  parts  of  the  conceptualized  system  were  scripted  and  programmed 
for  the  development  of  a  prototype.  These  parts  were: 

o  All  of  Subsystem  1  -  ORIENTATION 

o  Interests  assessment  and  Interpretation  In  Subsystem  2  -  SELF¬ 
INFORMATION 

o  The  goal,  "To  Complete  a  Next  Step  In  Education,"  In  Subsystem  3  - 
GOALS  AND  PLANNING 

o  A  demonstration  of  the  COUNSELOR/ADMINISTRATOR  Subsystem 
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The  AREIS  prototype  underwent  a  limited  field  tryout  at  Fort  SMI, 
Oklahoma.  AREIS  was  programmed  In  the  PLAN  IT  language  and  delivered  on  two 
terminals  connected  by  telephone  line  to  a  UNIVAC  1108  at  the  Edgewood 
Arsenal,  Maryland.  During  the  three-week  field  tryout  64  soldiers  and  12 
Counselors  used  AREIS. 

Findings  from  the  field  tryout  are  summarized  as  follows: 

1.  AREIS  courseware  and  software  was  generally  ready  for  operation, 
however  some  hardware  problems  would  have  to  be  resolved  before 
the  system  could  be  placed  In  operation. 

2.  Soldiers  perceived  Interaction  with  AREIS  to  be  useful  and 
Interesting  and  accepted  the  help  of  a  computer  for  educational 
and  vocational  planning. 

3.  Although  there  was  no  significant  change  In  the  specification  of 
educational  and  vocational  plans  of  soldiers  as  a  result  of  using 
AREIS,  this  lack  of  effect  seemed  to  be  due  more  to  the 
limitations  of  the  field  tryout  experience  than  to  the  content  of 
the  system  Itsel f . 

4.  Education  Center  personnel  reacted  very  favorably  to  AREIS;  they 
perceived  the  computer  to  be  a  valuable  tool  to  assist  with 
educational  and  vocational  planning. 

5.  Education  Center  personnel  viewed  the  style  of  presentation  as 
appropriate  for  Education  Center  clientele  and  felt  that  the 
Information  was  presented  accurately. 

6.  Although  the  PLANIT  software  was  usable  for  the  development  of 
AREIS,  a  number  of  problems  make  It  Inappropriate  for  full-scale 
Implementation  of  AREIS.  These  problems  Included  the  scrolling 
of  the  text  on  the  screen,  the  restriction  of  user  responses  to 
one  per  screen,  and  the  mobility  of  PLANIT  to  support  databases. 

Although  the  number  of  participants  was  small  and  AREIS  was  not  complete, 
results  of  this  tryout  suggested  that,  with  a  larger  sample  over  a  longer 
period  of  time,  the  following  would  be  obtained: 

1.  AREIS  could  be  placed  In  Army  Education  Centers  and  receive  the 
support  of  Counselors  and  other  staff  members. 
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2.  AREIS  would  be  viewed  by  soldiers  as  a  highly  useful, 

Interesting,  understandable,  and  acceptable  way  to  get 
Information  about  self,  about  educational  programs,  and 
about  career  options. 

3.  AREIS  could  help  soldiers  develop  educational  and  vocational 
plans. 

After  the  field  tryout  of  AREIS  at  Fort  Sill,  Oklahoma  an  assessment  of 
the  AREIS  delivery  system  was  made.  Four  hardware  configurations  were 
considered  for  the  further  Implementation  of  AREIS: 

1.  AREIS  would  operate  on  existing  hardware  at  each  post. 

2.  AREIS  would  run  on  a  centrally  located  mainframe  computer  and  be 
delivered  to  each  post  on  terminals  connected  to  the  mainframe  by 
telephone  lines. 

3.  AREIS  would  operate  In  a  distributed  network  environment  In  which 
microcomputers  would  use  AREIS  courseware  stored  on  a  mainframe 
but  maintain  Independent  data  storage. 

4.  ARE  IS  would  run  Independently  on  microcomputers  located  at  each 
post. 

The  four  hardware  configurations  were  evaluated  against  the  following 
cr  I  ter  I  a : 

1.  AREIS  courseware  must  Include  the  Soldier  Subsystems  and  the 
COUNSELOR/AOM I N I STRATOR  Subsystem  which  Includes  the  computer 
storage  and  retrieval  DA  Form  669. 

2.  The  computer  which  delivers  AREIS  must  be  capable  of  expansion 
to  support  other  computerized  functions  or  systems  which  the 
Army  may  develop  (e.g.,  transcript  registry  program;  the 
computerized  system  for  evaluating  ACES  programs;  and  a  manage¬ 
ment  Information  system)  for  use  In  Education  Centers. 
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3.  Communication  via  the  computer  must  De  established  "horizontally" 
among  Education  Centers  and  "vertically"  through  the  Army 
education  system;  that  Is,  among  these  Centers,  the  Education 

01  visions  of  the  Major  Commands,  and  the  Education  Directorate, 
Headquarters,  Department  of  Army. 

4.  A  mean  response  time  of  five  seconds  or  less  for  soldier  Inter¬ 
action  Is  required. 

5.  The  system  must  be  capable  of  handling  terminals  In  a  variety  of 
configurations  since  Army  posts  vary  greatly  In  size  and 
Education  Centers  may  be  either  centralized  or  decentralized  In 
physical  setting  or  function. 

6.  Individual  Education  Centers  on  posts  will  provide  a  minimum  of 
technical  support  to  the  system,  such  as  turning  the  system  on 
and  off  each  day  and  generating  and/or  maintaining  local 
Information  on  the  system. 

Table  1  summarizes  the  analysis  of  the  system  requirements  against  the 
four  proposed  hardware  configurations.  It  was  determined  that  further 
development  of  AREIS  would  utilize  microcomputers  operating  at  each  post 
Independently.  More  Information  about  the  rationale  for  this  decision  may  be 
examined  In  Harr  I s-Bow I sbey  and  Rabush,  1980. 
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Table  1 


Proposed  System  Configuration  and  Subsystem  Requirements 
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Note.  Adapted  from  Cost/Benefit  Analysis  of  the  Army  Education  Information 
System  (Research  Note  B2-4)  by  J.  Harrls-Bow Isbey  and  C.  Rabush.  Alexandria, 
VA:  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences, 
November  1980. 

The  first  phase  of  the  project  provided  functional  specifications  for  the 
courseware,  software,  and  hardware  of  ARE  IS.  A  limited  field  tryout  Indicated 
the  support  of  potential  system  users  regarding  the  value  of  the  AREIS 
Information  and  the  use  of  computers  In  the  counseling  process. 
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THE  SECOND  PHASE 


In  1981  ARI  contracted  with  Dl SCOVER/Amer lean  College  Testing  Program  to 
complete  the  second  phase  of  the  ARE  IS  project.  During  this  phase  the  ARE  IS 
concept  was  refined  and  the  complete  courseware  for  the  four  subsystems  was 
developed.  Two  hardware  systems  were  selected  and  AREIS  was  programmed  to 
operate  on  these  systems.  AREIS  was  evaluated  during  a  nine-month  field  test 
at  three  Army  sites. 

Completion  of  AREIS  Courseware 

Parts  of  previously  developed  courseware  were  revised  to  Include 
Information  on  government  policies  and  regulations  governing  various  ACES 
programs  which  had  been  put  In  place  after  the  Initial  development  of  the 
scripts.  This  work  focused  mainly  on  the  Information  In  Subsystem  1- 
ORI ENTAT ION,  and  on  the  goal,  "To  Complete  a  Next  Step  In  Education,"  In 
Subsystem  3-GOALS  AND  PLANNING. 

During  the  development  of  Subsystem  2-SELF  INFORMATION  a  1 1 terature 
search  was  conducted  on  military  work  values.  The  search  Indicated  that 
military  and  civilian  work  values  are  highly  congruent.  It  was  therefore 
determined  that  AREIS  would  Include  three  self-assessment  devices  created  tor 
civilian  career  guidance.  A  database  was  created  which  matched  425  civilian 
careers  with  military  occupational  specialties.  The  SELF-1 NFORMATION 
Subsystem  generates  lists  of  military  or  civilian  occupations  based  on  the 
soldier's  responses  to  the  UNIACT  Interest  Inventory  (@  1978),  an  Abilities 
Survey,  and  a  Work-Related  Values  Survey. 
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Scripts  for  the  goais  In  Subsystem  3  were  developed.  These  goals 
Include:  Getting  Promoted,  Developing  New  Interests,  Getting  Job  Skills, 
Completing  the  Next  Step  In  Education,  Planning  a  Military  Career,  Improving 
MOS  Proficiency,  Selecting  Another  MOS,  Improving  Basic  Skills,  Deciding  Upon 
Reenl I stment ,  and  Making  a  Vocational  Choice. 

The  design  of  Subsystem  4-COUNSELOR/ADMINISTRATOR  was  revised.  The 
decision  to  Include  an  automated  DA  Form  669  In  Subsystem  4  was 
reconsidered.  It  was  determined  that  the  DA  Form  669  could  not  easily  be 
transferred  to  other  posts  with  the  selected  microcomputer  configuration  of 
AREIS.  Soldiers  could  not  be  expected  to  hand  carry  floppy  disks  from  post  to 
post  with  any  greater  degree  of  success  than  that  with  which  they  presently 
transmit  the  paper  DA  Form  669.  Also  It  was  determined  that  Counselors  could 
access  and  update  the  paper  version  more  readily  than  the  computerized  version 
because  they  would  not  have  the  terminals  at  their  desks.  Therefore, 

Subsystem  4  was  scripted  to  provide  crosswalk  Information  on  military  and 
civilian  occupations,  the  capability  to  Input  post-specific  Information  In 
various  goals  of  Subsystem  3,  and  the  capability  to  Input  the  master  schedule 
of  courses  offered  on  or  near  post. 

The  complete  content  of  AREIS  scripted  for  the  field  test  Is  as  follows: 

Subsystem  1 -ORIENTATION 

o  Contents  and  operation  of  AREIS 
o  Services  of  the  Education  Center 

o  Brief  description  of  Army  Continuing  Education  System 
programs 
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Subsystem  2-SELF-l NFORMAT ION 


o  On-line  adml n Istratlon  and  Interpretation  of 

a.  The  UNIACT  Interest  Inventory  (@  1978,  American 
College  Testing  Program) 

b.  A  fourteen-item  Abilities  Survey 

c.  A  slxteen-ltem  Work  Values  Survey  based  on  the  work 
of  Dr.  Donald  Super  and  the  worldwide  WORK  IMPORTANCE 
STUDY 

o  Summary  of  assessment  Information  and  list  of  related 

occupations 

Subsystem  3-GOALS  AND  PLANNING 
o  Getting  Promoted 
o  Developing  Some  New  Interests 
o  Getting  Some  Job  Skills 
o  Completing  a  Next  Step  In  Education 
o  Planning  a  Military  Career 
o  Improving  MOS  Skills 
o  Selecting  Another  MOS 
o  Improving  Basic  Skills 
o  Deciding  about  Re-enl I stment 
o  Making  a  Vocational  Choice 
Subsystem  4-C0UNSEL0R/ADMI N1STRAT0R 

o  Military  and  civilian  occupations  crosswalks 
o  Localization  capability 

o  Master  schedule  of  courses  given  on  or  near  post 
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ARE  IS  Hardware 


It  was  determined  that  the  conf Iguratlon  for  each  field  test  site  would 
be  three  student  terminals  attached  to  one  hard  disk,  one  printer ,  and  one 
floppy  disk  drive.  Student  data  would  be  copied  from  the  hard  disk  onto 
floppy  disks.  Two  brands  of  microcomputers  were  selected  for  the  delivery  of 
AREIS.  The  Apple  computer  was  chosen  because  the  Education  Centers  of  the 
U.S.  Army  Forces  Command  use  Apples.  Three  Apple  microcomputers  were 
connected  to  a  10Mb  CORVUS  hard  disk,  a  CORVUS  Constellation  Multiplexer 
(MUX),  and  an  Okldata  printer.  AREIS  was  presented  In  black  and  white.  (See 
Figure  1 . ) 


FIGURE  1 

Schematic  of  the  Multi-user  Apple  Microcomputer 
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The  DISCOVERY  mu  1 1 (processor  was  selected  as  the  second  computer  based  on 
the  need  to  provide  a  computer  system  which  would  run  on  the  220-volt,  50- 
cycle  electricity  used  In  Europe.  This  computer  consisted  of  three 
keyboard/color  monitor  terminals  connected  to  a  central  processor,  a  53Mb  hard 
disk,  and  an  Okldata  printer.  (See  Figure  2.)  The  DISOOVERY  machine  used  In 
Europe  also  required  a  large  transformer  In  order  to  operate  correctly.  AREIS 
was  presented  In  color  on  the  DISCOVERY  microcomputer. 

FIGURE  2 

Schematic  of  the  DISCOVERY  Mu  1 1 Iprocessor 
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A  single-user  Apple  system  with  lOmb  CORVUS  hard  disk  and  Okldata  printer 
was  Installed  for  AREIS  demonstrations  at  the  Adjutant  General  Center, 
Education  Directorate  Office  In  Alexandria,  Virginia.  (See  Figure  3.) 

FIGURE  3 

Schematic  of  the  Single-user  Apple  Microcomputer 


Programming  AREIS 

AREIS  was  programmed  In  PASCAL  and  used  the  CP/M  operating  system.  AREIS 
was  programmed  on  the  DISCOVERY  microcomputer  and  then  the  programs  were 
modified  to  run  on  the  APPLE  microcomputer.  The  programs  were  designed  to  be 
user  friendly  enabling  soldiers  to  Interact  with  AREIS  courseware  with  or 
without  the  assistance  of  a  Counselor.  User  records  were  created  to  store  and 
monitor  each  soldier's  experience  and  the  computer  provided  feedback  on 
previous  sessions  upon  re-entry  Into  AREIS. 
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Documentation 


AREIS  was  designed  to  operate  at  each  post  without  external  assistance 
such  as  an  on-site  contractor.  Three  documents  were  prepared  to  support  the 
self-sufficiency  of  the  system.  An  Inservice  Training  Guide  was  developed  to 
familiarize  the  Education  Center  staff  with  the  content  of  AREIS,  the  theory 
which  supports  the  counseling  approach  of  the  system,  and  the  role  of  the 
Counselor  using  a  computer-based  Information  system  to  provide  guidance 
Information.  The  guide  was  developed  to  be  used  by  an  Inservlce  Trainer 
Identified  at  each  post.  A  Counselor  Guide  was  designed  to  provide  more 
specific  Interpretations  of  the  career  analysis  provided  by  AREIS.  It  also 
provides  Information  on  the  technical  operation  of  the  AREIS  hardwa-e. 

Details  are  given  on  how  to  power-up  the  system,  how  to  back  up  student 
records  onto  floppy  disks,  and  how  to  enter  data  Into  the  system  which  Is 
specific  to  the  educational  opportunities  at  each  post.  A  separate  Technical 
Guide  was  developed  which  focuses  on  the  operation  of  the  AREIS  hardware.  A 
User's  Guide  was  designed  to  assist  the  soldiers  at  the  terminal  by  providing 
Information  on  how  to  sign  on  and  off  the  system  and  general  Information  on 
the  purpose  of  AREIS. 


AREIS  Evaluation 

AREIS  with  Its  accompanying  Inservlce  Training  and  documentation  was 

evaluated  at  three  Army  posts  during  a  nine-month  field  test.  The  objectives 

of  the  evaluation  were  as  follows: 

t.  To  assess  the  technical  operation  of  AREIS  software  as 
conceptualized  and  Implemented 
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2.  To  assess  any  operating  problems  with  the  hardware 

3.  To  assess  soldier  reaction  to  ARE  I S  and  to  the  use  of  a  computer 
to  obtain  career  and  educational  Information 

4.  To  assess  Education  Services  Officer,  Education  Counselor,  and 
other  staff  reaction  to  AREIS  and  to  the  use  of  a  computer  to 
provide  career  and  educational  Information 

5.  To  assess  changes  In  the  Education  Center  operation  as  a  result 
of  AREIS  presence 

The  next  section  will  describe  the  demographic  characteristics  of  the 
three  posts  selected  as  AREIS  field  test  sites,  the  typical  counseling 
activities  that  occur  at  each  post,  and  the  Installation  of  AREIS  at  each 
site. 

Fort  Meade,  Maryland.  Military  personnel  at  Fort  Meade,  Maryland,  are 
assigned  to  various  branches  of  the  armed  services.  The  Army  comprises  50?  of 
the  total,  and  the  Navy,  Air  Force,  and  Marines  comprise  the  remaining  50?. 

All  of  the  Navy,  Air  Force,  and  Marine  personnel  and  half  of  the  Army 
contingent  are  assigned  to  the  Intelligence  unit  at  the  National  Security 
Agency.  Of  the  remaining  25?,  the  Military  Police  unit  and  the  medical 
battalion  are  composed  of  soldiers  who  must  be  high  school  graduates  and  have 
an  Armed  Services  Vocational  Aptitude  Battery  score  of  I00+.  At  Fort  Meade, 
most  soldiers  come  to  the  Education  Center  to  learn  about  college  courses  and 
to  use  the  tuition  assistance  programs.  Only  a  very  small  percentage  of  the 
total  Fort  Meade  population  can  be  considered  BSEP  (Basic  SKI  I  Is  Education 
Program)  eligible  (4?),  and  an  even  smaller  number  (2.5?)  have  not  graduated 
from  high  school. 
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At  the  Education  Center,  AREIS  was  Installed  on  the  multi-user  APPLE 
system  and  placed  In  a  room  and  removed  from  the  reception  area  and  the 
Counselors'  offices.  This  location  was  selected  by  the  staff  because  the  room 
could  be  secured  during  the  hours  that  the  Education  Center  was  closed.  The 
room  was  not  In  the  normal  traffic  flow,  and  passersby  could  not  see  the  AREIS 
computers.  Soldiers  using  AREIS  had  some  degree  of  privacy  from  other 
serv Icemembers  waiting  In  the  reception  area  to  see  a  Counselor.  The  staff 
originally  planned  to  place  a  Counselor  In  this  room  to  monitor  AREIS  use;  the 
decision  was  soon  reversed,  however,  when  the  Counselor  felt  that  counseling 
clients  In  the  same  area  with  AREIS  users  was  an  Impractical  situation.  The 
Counselor  moved  back  to  his  office  and  the  AREIS  room  was  unmonitored  for  the 
remainder  of  the  evaluation  period. 

Fort  Gordon,  Georgia.  Approximately  16,000  Army  personnel  are  In  residence  at 
Fort  Gordon.  Two  signal  corps  training  brigades.  Involved  In  Advanced 
Individual  Training  (AIT)  activities,  comprise  35-40$  of  the  population.  The 
rest  of  the  military  component  Is  classified  as  permanent  party,  a  large 
percentage  of  which  Is  Involved  In  the  Instruction  of  the  Signal  AIT  troops. 
Many  permanent  party  soldiers  who  are  becoming  established  In  their  military 
career  go  to  the  Education  Center  to  evaluate  their  military  experience  for 
credit  toward  an  Associate  of  Arts  degree.  These  soldiers  enroll  In 
technical,  electronics-related  courses  and  use  the  tuition  assistance 
program.  The  training  brigade  personnel  do  not  use  the  Education  Center  for 
In-depth  counseling  or  educational  services;  because  they  are  heavily  Involved 
with  their  military  training,  they  have  little  time  for  other  educational 
activities.  They  may  request  assistance  In  evaluation  of  college  transcripts 
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or  Information  about  College  Level  Examination  Program  (CLEP)  or  General 
Educational  Development  (GED)  tests. 

The  Education  Center  at  Fort  Gordon  occupies  several  buildings:  one 
building  houses  the  Administrative  offices;  one  the  Counseling  Center;  and  one 
the  MOS  Library.  AREIS,  Installed  on  the  DISCOVERY  computer  was,  located 
directly  Inside  the  main  door  to  the  Counseling  Center,  to  one  side  of  the 
small  reception  area.  Every  soldier  who  came  to  the  Counseling  Center  could 
see  the  computer.  Many  times  soldiers  sat  In  front  of  the  terminals  as  they 
waited  to  see  a  counselor;  however,  signs  placed  on  each  terminal  by  the 
Education  Center  staff  requested  that  soldiers  not  use  the  computer  until  they 
had  seen  a  Counselor.  Soldiers  who  were  put  on  AREIS  by  a  Counselor  had  no 
privacy  as  they  worked  on  the  computer. 

Mannheim,  Germany.  The  Mannheim  community  Is  composed  of  several  posts 
located  within  close,  but  not  adjacent,  proximity  to  one  another.  The  troop 
population  for  this  military  community  totals  approximately  7,000  to  8,000 
soldiers.  Most  of  the  units  serve  as  combat  arms  and  combat  support; 
consequently,  soldiers  spend  most  of  their  duty  time  In  the  field  on  training 
maneuvers.  A  high  percentage  of  these  soldiers  Is  high  school  educated; 
however,  many  of  them  are  rated  as  BSEP  eligible. 

Most  of  the  posts  In  Europe  have  an  Education  Center  of  some  kind, 
ranging  from  one  Counselor  and  a  few  courses  to  three  or  four  Counselors,  an 
MOS  Library  within  the  building,  education  Institution  registrars,  and  many 
ongoing  courses.  Because  the  soldiers  spend  so  much  time  In  the  field,  the 
Education  Centers  must  plan  very  flexible  scheduling  of  their  education 
programs.  The  college  programs  offered  are  mostly  lower  level,  technically 
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oriented  courses;  there  are  very  few  "pure"  liberal  arts  courses  offered  In 
Mannhe Im. 

ARE  I S  operated  on  two  of  the  Mannheim  posts,  Sul  1 1  van  Barracks  and 
Coleman  Barracks.  The  Sullivan  Education  Center  housed  the  Mannheim  Community 
Education  Center  administrative  offices,  one  counselor,  educational 
registrars,  and  classrooms.  AREIS,  Installed  on  the  DISCOVERY  computer,  was 
placed  In  a  room  between  the  Counselor's  office  and  the  classrooms.  The 
computer  was  not  readily  visible  by  soldiers  who  were  In  the  building  to  see  a 
Counselor  or  to  register  for  courses  (education  Institution  registrars  were 
housed  on  the  first  floor  of  the  building).  It  was  visible  to  those  soldiers 
who  were  attending  classes  In  the  evening.  AREIS  remained  In  this  location 
tor  three  months  until  or  after  which  the  building,  about  to  undergo 
renovation,  was  closed  and  the  staff  and  programs  were  moved  to  other 
tael  I Itles. 

AREIS  was  reinstalled  In  the  MOS  library  located  at  Coleman  Barracks  and 
was  located  there  for  the  remainder  of  the  evaluation  period.  This  location 
was  centrally  located  and  close  to  the  Counselors'  offices.  It  was  readily 
visible  to  soldiers  coming  to  the  MOS  Library  tor  reference  materials  and/or 
Information  about  military  coursework  or  for  coffee  during  class  breaks;  and 
the  MOS  Librarian  was  always  available,  It  necessary,  to  assist  soldiers  at 
the  terminal  . 

Proced ure .  After  AREIS  was  Installed  at  each  site,  a  Field  Test  Coordinator, 
usually  a  member  of  the  counseling  staff,  participated  In  a  four-hour  training 
program  on  the  operation  of  the  AREIS  hardware  and  software.  A  two-day 
Inservice  Training  Program  was  then  presented  to  the  Education  Center 

personnel.  This  two-day  program  Included: 
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Information  about  the  theoretical  basis  of  AREIS 
Information  about  the  content  of  AREIS 

In-depth  hands-on  experience  at  the  AREIS  computer  to  assure  that  al I 
Counselors  and  staff  Involved  with  soldiers  were  familiar  with  the 
operation  of  the  computer  and  with  the  AREIS  content  explanation  of  the 
procedure  which  Counselors  would  use  to  collect  data  for  the  analysis  of 
the  effectiveness  of  AREIS 

These  data,  to  be  recorded  on  the  dally  counselor  logs,  would  Include: 

—  average  length  of  Interview  for  AREIS  users  and  non-users 

—  kinds  of  action  taken  within  the  Interview  for  AREIS 
users  and  non-users 

Instruction  to  the  Field  Test  Coordinators  In  backlng-up  the  evaluation 
data  onto  floppy  disks  or  to  a  video  tape  recorder  to  protect  the  data 
from  some  occurence  which  might  erase  the  program  (e.g.,  an 
electricity  problem  or  electrical  storm) 

The  final  activity  prior  to  the  onset  of  soldier  use  was  the  localization 
of  the  AREIS  data  used  In  Subsystem  3-GOALS  AND  PLANNING.  Local  data 
Included,  among  others,  the  location  of  the  MOS  Libraries,  the  names  and 
addresses  of  the  re-en I Istment  Non-CommI ss loned  Officers,  activities  on  post 
which  related  to  off-duty  Interests,  a  listing  of  all  educational  Institutions 
providing  courses  on  post,  and  a  master  schedule  of  those  courses.  An 
Education  Center  staff  member  was  trained  to  use  the  AREIS  author  language  to 
Input  all  the  local  Information  Into  Subsystem  4  of  AREIS.  Onsite  personnel 
were  Instructed  to  update  these  sections  each  time  local  Information  changed. 

Once  the  Installation  and  Inserylce  training  phase  was  complete,  the 
project  staff  departed  and  the  Education  Center  staff  began  using  AREIS  as  a 
part  of  the  ongoing  Education  Center  activity.  The  Field  Test  Coordinator  was 
responsible  for  turning  on  the  computer  In  the  morning  and  turning  It  off  In 
the  evening.  All  Counselors  were  Instructed  to  Invite  soldiers  to  use  the 
system  and  to  provide  assistance  with  AREIS  or  the  computer.  If  necessary. 

The  clerical  staff  was  to  Introduce  soldiers  to  the  computer  and  also  to 
provide  assistance  In  the  update  of  the  post-specific  data  (person  appointed 
by  the  Field  Test  Coordinator).  The  Field  Test  Coordinator  was  Instructed  to 
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back  up  the  evaluation  data  every  two  weeks  onto  floppy  disks  or  onto  a  video 
tape  recorder.  This  process  took  from  thirty  minutes  to  one  hour  to  complete. 

Once  soldiers  entered  the  Education  Center,  they  were  Invited  by  a 
Counselor  or  another  staff  member  to  use  ARE  I S.  If  a  soldier  responded 
negatively,  no  effort  was  made  to  convince  hl^/her  to  Interact  with  the 
system.  After  signing  on  to  the  system  by  entering  service  number  and  name, 
the  soldier  completed  an  on-line  pre-use  questionnaire  which  requested  data 
about  age,  rank,  time  In  grade,  time  on  post,  approximate  use  of  the  Education 
Center;  about  personal  progress  related  to  vocational  and  education  decision¬ 
making;  and  about  attitudes  toward  using  a  computer  to  gain  vocational  and 
educational  knowledge.  The  Pre-Use  Questionnaire  can  be  found  In  Appendix 
A.  The  soldier  then  moved  through  the  ARE  I S  content  according  to  his/her 
needs  and  available  time.  Once  the  soldier  learned  the  basic  commands 
necessary  to  operate  ARE  IS,  the  staff  member  withdrew.  After  the  soldier 
concluded  his/her  Interaction  with  AREIS  the  soldier  responded  to  a  post-use 
questionnaire  (Appendix  B)  which  was  designed  to  elicit  attitudes  on  the 
usefulness.  Interest  level,  and  clarity  of  AREIS. 

Four  Pre-Use  Questionnaire  Items  were  repeated  on  the  Post-Use 
Questionnaire  to  assess  any  changes  In  vocatlonal/educatlonal  decl s lon-mak I ng 
and  In  attitudes  toward  the  use  of  the  computer  for  vocational  and  educational 
planning.  Not  all  soldiers  completed  the  Post-Use  Questionnaire.  This  may 
have  occurred  because: 

the  soldier  had  to  leave  and  had  no  time  to  sign-off  using  the  proper 
procedure. 

the  soldier  had  difficulty  and  left  without  asking  for  help  and  without 
signing  off  properly. 

the  computer  malfunctioned  and  dropped  the  soldier  out  of  the  AREIS 
program. 
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In  these  cases  Counselors  were  able  to  restart  the  AREIS  courseware  without 
moving  through  the  post-use  questions. 

Counselors  and  other  staff  members  were  encouraged  by  the  Education 
Center  Officers  to  use  AREIS.  Project  staff  Interviewed  these  Individuals 
about  their  opinions  on  the  usefulness,  Interest  level,  understandabl 1 1 ty ,  and 
appropriateness  of  AREIS  at  the  end  of  the  field  test.  The  Structured 
Interview  for  Counselors  may  be  examined  In  Appendix  C. 


Participants.  During  the  field  test  a  total  of  1,114  soldiers  and  Education 
Center  staff  members  used  AREIS.  The  1,050  soldiers  (.80%  male,  20%  female) 
had  served  In  the  Army  from  zero  to  thirty  or  more  years  (mean  time  In  service 
=  5.5  years)  and  had  been  In  their  present  grades  tor  an  average  of  2.5 
years.  They  had  been  stationed  at  their  current  posts  for  an  average  of  nine 
months  and  had  used  the  Education  Centers  an  average  of  five  times.  Table  2 
provides  a  breakdown  of  those  who  used  AREIS. 


Table  2 


AREIS  Users 


Rank 

Number 

Percent 

E-2 

144 

13$ 

E-3 

214 

19$ 

E-4 

254 

23$ 

E-5 

194 

17$ 

E-6 

123 

1  1$ 

E-7 

46 

4$ 

E-8 

23 

2$ 

E-9 

5 

M 

Warrant  Officer 

15 

\% 

Officer 

32 

3$ 

Education  Counsel  or /Others 

64 

6$ 

Total 

1,TT4~ 

Idol" 
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F I  nd I ngs .  This  section  will  present  the  findings  cf  the  evaluation  based  upon 
soldiers'  responses  to  the  Pre-  and  Post-Use  Questionnaires,  the  Field  Test 
Coordinators'  logs,  and  the  structured  Interviews  with  the  Counselors.  The 
findings  are  summarized  according  to  the  objectives  of  the  evaluation  stated 
previously. 


Objective  1:  To  assess  the  technical 
operation  of  the  ARE  I S  software  as 
conceptualized  and  Implemented. 

Generally,  the  AREIS  software  functioned  well  during  the  Field  Test. 
Elghty-one  percent  of  the  soldiers  who  responded  to  the  Post-Use  Questionnaire 
reported  that  they  had  no  difficulty  using  AREIS.  (See  Table  3.)  Because  of 
the  on-line  method  of  collecting  the  evaluation  data,  there  Is  no  way  to 
ascertain  If  soldiers  who  left  AREIS  prior  to  responding  to  the  Post-Use 
Questionnaire  had  difficulty  with  the  machine  or  the  software  or  If  they  left 
tor  other,  unrelated  reasons. 

Table  3 

Operation  of  AREIS 


Did  you  have  any  of  these  problems? 


1 . 

Trouble  with  the  computer 

182 

11$ 

2. 

Directions  for  using  the  computer  were  not  clear 

42 

3$ 

3. 

Directions  for  using  AREIS  were  not  clear 

33 

2$ 

4. 

It  was  boring 

51 

3$ 

5. 

No  problems 

1,322 

81$ 

1,630 

100$ 
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There  is  no  evidence  of  users  having  difficulty  operating  AREIS  in 
Subsystems  1  and  3.  In  the  structured  interviews  at  the  conclusion  of  the 
Field  Test,  however,  some  Counselors  noted  that  information  dealing  with  ACES 
programs  had  become  out  of  date  due  to  changes  in  policy  since  the  AREIS 
scripts  were  written.  The  Field  Test  Coordinator  at  Fort  Meade  observed  that 
the  MOS  designations  for  officers  appeared  to  be  Air  Force  numbers  rather  than 
Army  numbers  and  the  Coordinator  at  Fort  Gordon  felt  that  the  MOS/Civilian 
occupation  articulation  for  S ignal-re lated  MOS's  was  not  complete,  the 
promotion  procedure  needed  to  be  updated,  and  that  more  information  needed  to 
be  added  to  each  topic  area. 

In  Subsystem  2,  the  programming  of  the  interpretation  of  the  Abilities 
Survey  caused  frustration  for  some  soldiers  who  rated  many  of  their  abilities 
equally.  The  program  would  not  produce  a  list  related  to  the  soldiers  input 
it:  the  soldier  scored  a  three-way-or-more  tie  on  the  six  ability  pairs  or  if 
the  soldier  entered  an  educational  level  which  had  no  occupations  in  the 
ability  areas  rated  high  by  the  soldier.  For  example,  if  a  soldier  rated  very 
high  on  manua I /mechan ical  abilities  and  requested  careers  requiring  a  graduate 
school  educational  level,  no  occupations  could  be  identifed  because  there  are 
no  graduate  level  manual /mechan ical -rel ated  occupations  in  the  AREIS  data 
file.  This  problem  was  observed  early  in  the  Field  Test.  The  AREIS  software 
was  not  modified  however  because  the  hard  disks  would  have  had  to  have  been 
removed  from  the  Field  Test  sites,  reprogrammed,  recompiled,  and  re¬ 
installed.  It  was  determined  that  this  would  be  too  expensive  and  time- 
consuming.  Therefore  the  Education  Center  Counselors  were  given  a  written 
explanation  of  the  problem  with  the  Interpretation  of  the  abilities  survey  and 


documentation  for  the  User's  Guide  which  explained  possible  remedies  for  the 
soldier  who  encountered  the  problem. 

Another  situation  occured  at  Fort  Meade  throughout  the  Field  Test.  A 
soldier  who  returned  to  ARE  IS  sometimes  received  a  "string  too  long"  message 
when  entering  the  service  number.  At  this  point  the  computer  would  return  the 
user  to  the  CP/M  operating  system,  causing  contusion  as  to  how  to  proceed.  A 
Counselor  would  have  to  type  In  AREIS  In  order  to  reinitialize  the  sytem. 
Counselors  did  not  keep  a  record  on  the  number  of  times  that  this  situation 
occurred;  hence  there  are  no  hard  data  on  the  severity  of  the  problem. 
Counselors  did  report  the  situation  to  project  staff;  however,  due  to  the  lack 
of  access  to  an  Apple  computer  for  extensive  testing  In  the  exact  condition  as 
the  Fort  Meade  machine,  there  was  no  way  to  conduct  testing  that  would 
determine  If  the  problem  was  software  or  hardware  related. 

In  the  Structured  Interview,  Counselors  related  that  soldiers  were  often 
frustrated  by  the  Inflexibility  of  the  AREIS  software.  Although  AREIS  Itself 
allows  users  to  move  freely  among  the  various  sections  of  the  system,  to  back 
up  as  many  frames  as  desired,  and  to  copy  or  exit  from  any  screen ,'30 Idlers 
who  were  viewing  the  entry  (Pre-Use  Questionnaire)  and  exit  (Post-Use 
Questionnaire)  sections  were  often  frustrated  because  they  were  required  to 
respond  to  each  frame  In  order.  It  must  be  stressed  that  this  Inflexibility 
was  a  function  of  the  on-line  evaluation  sections  that  were  needed  to  analyze 
the  operation  and  Impact  of  AREIS  program  and  Its  use.  An  operational  AREIS 
would  not  contain  these  evaluation  sections. 
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Objective  2:  To  assess  any  operating 
problems  with  the  hardware. 

The  Field  Test  uncovered  a  number  of  hardware-related  technical 
problems.  These  problems  affected  opinion  about  AREIS  on  the  part  of  soldiers 
and  Counselors  alike.  Eleven  percent  of  the  soldiers  reported  "having  trouble 
with  the  computer;"  (see  Table  3)  and  thirty-six  percent  of  the  Counselors 
felt  that  the  computer  was  "broken  too  much"  (See  Table  4). 

Table  4 

Counselor  Reactions  to  AREIS  Operation 


The 

worst  thing  about  AREIS  was  (more  than  one  answer) 

1 . 

The  machine  was  broken  too  much 

9 

36% 

2. 

There  wasn't  enough  Information  that  soldiers 
wanted  to  know 

5 

20% 

3. 

There  was  too  much  content;  It  took  too  long 
for  soldiers  to  go  through;  It  was  confusing 

9 

36% 

4. 

Working  with  a  machine;  It  was  too  Impersonal 

1 

4* 

5. 

Al  1  of  the  above 

0 

0% 

6. 

No  Response 

1 

25 

4$ 
1 00% 

Some  of  the  technical  problems  appeared  to  be  related  to  the  specific 
kind  of  computer.  These  will  be  discussed  Individually. 

The  Fort  Meade  Apple  system  had  problems  with  tracking  soldier  records. 
First,  the  CORVUS  hard  disk  assigned  the  AREIS  program  to  one  area  In  the  hard 
disk  which  was  common  to  all  three  computers.  It  also  assigned  each  computer 
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to  Its  own  separate  storage  area;  hence,  soldiers  had  to  return  to  the  same 
computer  each  time  they  used  ARE  I S.  If  they  used  another  computer,  the  hard 
disk  would  not  be  able  to  access  their  previous  records  and  could  not 
"remember"  them.  To  facilitate  soldiers  returning  to  the  same  computer,  the 
machines  were  labelled  alphabetically  (e.g.,  soldiers  with  last  names  of  A-H 
used  computer  I,  l-Q  used  computer  2,  and  R-Z  used  computer  3). 

Second,  when  soldiers  wished  to  make  copies  of  Information  seen  on  the 
screen  of  a  particular  computer,  they  had  to  activate  a  separate  switch  box  so 

that  the  printer  could  Identify  the  computer  requesting  the  copy.  This 

situation  was  cumbersome  when  more  than  one  soldier  was  Interacting  with  AREIS 
at  the  same  time.  Also,  the  knob  on  the  box  came  off  periodical ly.  The  Fort 
Meade  Coordinator  finally  used  super  glue  to  affix  the  knob  permanently. 

The  Fort  Gordon  DISCOVERY  computer  was  plagued  with  start-up  problems;  on 
an  average  of  three  times  a  week,  the  computer  would  boot  up  one  or  two 
terminals  Instead  of  all  three.  This  situation  meant  that  often  the  Counselor 
In  charge  of  Initializing  the  system  had  to  spend  a  half  hour  or  more  frying 
to  get  al I  three  terminals  running.  The  Field  Test  Coordinator  characterized 
the  system  as  "unreliable,  Inconsistent,  and  Impossible  to  keep  running." 
Approximately  two  months  after  the  beginning  of  the  Field  Test,  new  chips  were 

Installed  In  the  DPC  boards  of  the  computer;  at  that  time  all  terminals 

started  up.  The  adjustment  gradually  deteriorated  after  several  months  until 
the  computer  again  would  not  boot  all  three  terminals. 

The  Field  Test  Coordinator  also  reported  difficulty  In  cleaning  the 
filters  on  the  machine.  The  DISCOVERY  unit  has  three  parts,  the  service 
processor,  the  disk  drive  unit,  and  the  hard  disk,  which  sTt  one  on  top  of  the 
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other.  To  clean  the  hard  disk  filter,  the  computer  must  be  disassembled, 
which  was  a  time-consuming  task. 

The  Mannheim  DISCOVERY  computer  operated  successfully  for  three  months 
prior  to  Its  move  to  a  new  location.  Shortly  after  the  transfer  of  the 
equipment,  the  machine  stopped  running  and  several  of  the  micro  chips  had  to 
be  replaced.  It  Is  not  known  If  the  move  caused  the  subsequent  breakdown. 

The  system  was  repaired  but  broke  down  four  months  later.  This  time  the 
failure  of  the  machine  appeared  to  be  gradual  In  nature.  The  Coordinator  at 
Mannheim  reported  that  the  start-up  process  took  longer  and  longer  until  It 
finally  would  not  start  at  all.  After  a  series  of  trouD I  e-shoot  I ng  activities 
the  system  was  repaired.  The  lack  of  service  facilities  was  a  severe  problem 
at  the  Mannheim  site. 

Another  problem  appeared  to  be  common  to  at  I  of  the  computers.  The 
Counselors  reported  that  the  computer  occasionally  dropped  out  of  the  ARE  I S 
program  and  back  to  the  CP/M  operating  system.  This  might  happen  when  no  one 
was  using  AKEIS;  In  this  case  a  staff  member  would  restart  ARE  I S  before  a 
soldier  began  the  program.  The  problem  sometimes  occurred  while  a  soldier  was 
using  ARE  IS.  This  situation  was  more  serious  because  the  record  of  the  ARE  I S 
session  was  lost,  and,  after  AREIS  was  reinitialized,  the  soldier  had  to  redo 
the  activities  that  had  previously  been  completed  If  that  Information  was  to 
be  stored  In  the  computer.  There  Is  a  strong  possibility  that  the  "drop  out" 
situation  was  caused  by  an  uneven  source  of  electricity.  The  hard  disk  Is 
designed  to  spin  at  a  constant  speed  of  3000  rpm.  A  dlmunltlon  of  electricity 
could  slow  the  disk  speed,  causing  the  head  to  drop  down  at  the  wrong  spot  on 
the  disk.  The  computer,  unable  to  read  the  correct  data,  aborts  the  program, 
and  returns  to  the  operating  system  level.  All  the  buildings  In  which  AREIS 


27 


was  Instal  lea  are  World  war  I  I  vintage;  It  Is  highly  I Ikely  that  these 
buildings  are  not  wired  adequately  for  the  computer  to  run  successfully  along 
with  other  kinds  of  equipment,  such  as  electric  typewriters,  coffee  pots,  and 
air  conditioners.  The  presence  of  an  uncommon  amount  of  dust  and  dirt  In  the 
environment  also  creates  a  potential  for  operational  difficulties  In 
microcomputers.  Dirt  In  the  fan  assembly  and  filters  were  found  In  the 
Mannheim  and  Fort  Gordon  computers.  The  Education  Center  at  Fort  Meade  was 
not  located  near  any  training  area;  therefore,  the  environment  was  not  so 
dust-laden  as  the  other  two  locations.  A  preventive  maintenance  schedule 
should  have  been  established  when  the  equipment  was  Installed. 

Objective  3;  To  assess  soldier  reaction  to 
ARE I S  and  to  the  use  of  a  computer  to  obtain 
career  and  educational  Information. 

As  In  the  previous  limited  field  tryout  of  ARE  I S ,  the  majority  of 
soldiers  who  used  AREIS  reacted  very  favorably  to  the  program  and  to  the  Idea 
of  receiving  career  and  educational  Information  from  a  computer.  Specific 
findings  elicited  from  the  Pre-  and  Post-Use  Questionnaires  follow. 

Analysis  of  the  Pre-  and  Post-Use  Questionnaires  dealing  with  usefulness 
of  AREIS  for  career  and  educational  planning  Indicates  that  soldiers  felt  very 
positive  about  the  use  of  a  computer  for  these  kinds  of  activities.  In  the 
pre- treatment  questionnaire,  83$  of  the  soldiers  responded  favorably  about 
using  AREIS  for  career  planning,  while  85$  felt  that  a  computer  could  help 
with  educational  planning.  After  using  AREIS,  those  percentages  rose  to  86$ 
and  87$  respectively  (See  Table  5). 
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Table  5 


Usefulness  for  Planning 


Question 

Pre-Use 

Questionnaire 

N=1 050 

Post-Use 

Questionnaire 

N= 1 050 

For  help  with  my  career  planni 

ng. 

a  computer  would  be: 

1.  Very  useful 

54? 

63$ 

2.  useful 

31 $ 

23$ 

3.  Undecided 

14$ 

9% 

4.  Not  very  useful 

\% 

2$ 

5.  Not  at  a  1  1  usefu 1 

0$ 

3$ 

For  help  with  my  educational 

planning,  a  computer  would  be: 

1  .  Very  useful 

52$ 

61$ 

2.  Useful 

35$ 

25$ 

3.  Undecided 

12$ 

8$ 

4.  Not  very  useful 

\% 

3$ 

3.  Not  at  al 1  useful 

0$ 

3$ 

Little  movement  toward  specification  In  the  areas  of  career  and 
educational  planning  took  place  within  the  total  population  who  used  ARE  I S. 
(See  Table  6.)  More  than  seventy  percent  of  the  soldiers  used  ARE  I S  only  one 
time;  for  this  population  the  treatment  process  was  too  short  to  have  produced 
any  measurable  change. 
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Table  6 


i 

i 


Specification  of  Plans 


Pre-Use  Post-Use 

Question  Questionnaire  Questionnaire 

N= 1U50  N= 1050 


At 

this  point,  1  have: 

1  . 

No  idea  about  my  future  career 
p  Ians 

19$ 

18$ 

2. 

Some  vague  ideas  about  my  future 
career  plans 

38$ 

36$ 

3. 

Narrowed  future  plans  to  2  or 

3  choices. 

29$ 

30$ 

4. 

Narrowed  future  plans  to  1 
certa in  career . 

14$ 

16$ 

At 

tnis  point,  1  have: 

1  . 

No  idea  about  my  educational 
plans. 

15$ 

17$ 

2. 

Some  vague  ideas  about  my 
educational  plans. 

40$ 

35$ 

3. 

Narrowed  my  educational  plans 
to  1  or  2  possible  types 

35$ 

31$ 

4. 

Selected  one  program  for 
more  education  or  training. 

10$ 

17$ 

Because  so  many  soldiers  had  interacted  with  AREIS  only  once,  the  project 
staff  identified  a  sub-sample  of  the  total  population  which  had  used  the 
program  at  least  two  times,  with  a  minimum  of  sixty  days  elapsing  between  the 
first  and  last  interaction.  An  analysis  of  the  opinions  of  these  fourteen 
repeat  users  shows  somewhat  different  results.  On  the  Pre-Use  Quest ionna i re 
100)1  of  the  users  felt  that  use  of  a  computer  would  be  useful  for  career  and 
educational  planning.  On  the  Post-Use  Questionnaire,  the  percentage  reporting 
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very  favorable  or  favorable  opinions  dropped  to  seventy-one  percent. 
Table  7.)  In  each  case  the  difference  was  statistically  significant 


( See 


.  This 


change  In  attitude  may  be  a  reflection  of 
computers  Initially,  or  may  have  resulted 
problems . 


overly  optimistic  expectations  for 
from  frustration  with  equipment 


Table  7 


Opinions  of  Sub-sample  on  Planning 


Pre-Use 

Post-Use 

Question 

Questionnaire 

Questionnaire 

N=14 

N=  1 4 

For  help  with  my  career  plannl 

ng, 

a  computer  would  be: 

1  .  Very  useful 

71$ 

64$ 

2.  Useful 

29 $ 

7$ 

3.  Undecided 

0% 

7$ 

4.  Not  very  useful 

0$ 

7$ 

5.  Not  at  a  1 1  useful 

0$ 

14$ 

Mean 

1 .3 

2.0 

For  help  with  my  educational 

planning,  a  computer  would  be: 

1  .  Very  useful 

64$ 

57$ 

2.  Useful 

36$ 

14$ 

3.  Undecided 

0$ 

21$ 

4.  Not  very  useful 

0$ 

0$ 

5.  Not  at  al 1  useful 

0$ 

7$ 

Mean 

1.3 

1 .9 

This  number  represents  users  who  Interacted  with  ARE  IS  on  dates  at  least  60 


days  apart. 
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In  the  area  of  career  planning,  the  sub-sample  of  fourteen  subjects 
showed  little  movement  toward  specificity.  (See  Table  8.)  On  the  Pre-Use 
Questionnaire  57$  of  the  respondents  indicated  that  they  had  narrowed  their 
career  choices  to  two  or  three  choices.  The  same  respondents  showed  movement 
on  the  Post-Use  Questionnaire,  but  in  both  directions,  which  would  appear  to 
indicate  that  ARE  I S  aided  some  soldiers  (22$)  to  become  more  definite  in  their 
career  plans  while  it  caused  some  soldiers  (7$)  to  begin  to  rethink  their 
futures  with  regard  to  careers. 

Describing  their  educational  planning  on  the  Pre-Use  Questionnaire,  50$ 
of  the  soldiers  had  narrowed  their  choices  to  one  or  two  programs  and  14$  had 
selected  one  specific  program.  By  the  time  these  soldiers  finished  their  last 
ARE  I S  use,  an  additional  15$  had  moved  toward  specificity  of  educational 
choice.  (See  Table  8.)  No  statistically  significant  difference  was  found  to 
exist  in  the  Pre-  and  Post-Use  responses  dealing  with  careers  or  education. 


Table  8 


Opinions  of  Sub-sample  about  Specification  of  Plans 


Pre-Use 

Ouestion  Questionnaire 

N=14 

Post-Use 

Questionnaire 

N=1 4 

At 

this  point,  1  have: 

1 . 

No  idea  about  my  future 

career  plans. 

21? 

21? 

2. 

Some  vague  ideas  about  my 

future  career  plans. 

M? 

21? 

3. 

Narrowed  future  plans  to  2  or 

3  choices. 

57? 

29? 

4. 

Narrowed  future  plans  to  1 

certain  career. 

7? 

29? 

At 

this  point,  1  have: 

1  . 

No  idea  about  my  educational 

plans. 

7? 

7? 

2. 

Some  vague  i deas  about  my 

educational  plans. 

29? 

29? 

3. 

Narrowed  my  educational  plans 

to  l  or  2  possible  types  of 

tra i n i ng . 

50? 

36? 

4. 

Selected  one  program  for  more 

education  or  training. 

14? 

29? 

» 

This  number  represents  users  who  interacted  with  AREIS  on  dates  at  least 
sixty  days  apart. 


Soldiers  also  responded  to  a  post-use  question  about  which  part  of  AREIS 
was  the  most  useful.  As  in  the  field  tryout  at  Fort  Sill,  soldiers  indicated 
that  Subsystem  2,  SELF- I NFORMAT ION ,  was  the  most  helpful  section  of  AREIS. 
(See  Table  9.)  Nearly  one-third  of  the  soldiers  believed  that  Subsystem  3, 
GOALS  AND  PLANNING,  was  the  most  helpful. 
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Table  9 


Most  Useful  Part  of  ARE  IS 


Question 


N  =  1050 


Which  part  of  the  ARE  IS  was  the 
most  useful  to  you? 


1 . 

Orientation  (Part 

1  ) 

23$ 

2. 

Se 1 f- Informat  ion 

(Part 

1  1) 

48$ 

3. 

Goal s  &  Planning 

(Part 

III) 

29$ 

Counselors  also  felt  that  Subsystem  2  was  very  useful  to  their  clients.  When 
asked  to  select  the  most  useful  parts  of  AREIS,  16$  selected  the  interest 
inventory;  1 1  $  selected  the  abilities  survey;  and  10$  chose  the  values 
section.  These  percentages  were  among  the  highest  responses  to  that  question. 

Similar  soldier  responses  were  found  in  the  area  of  interest.  Table  10 
shows  that  almost  one-half  of  the  soldiers  found  Subsystem  2,  SELF¬ 
INFORMATION,  to  be  the  most  interesting  part  of  AREIS. 

Table  10 

Most  Interesting  Part  of  AREIS 

Question  N  =  1050 


Which  part  of  the  AREIS  was  the 
most  interesting  to  you? 


1  . 

Orientation  (Part 

i  ) 

24$ 

2. 

Sel f-lnformation 

(Part 

II) 

45$ 

3. 

Goals  4  Planning 

(Part 

IN) 

31$ 
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It  w as  also  important  to  learn  whether  soldiers  could  understand  the 
information  being  delivered  via  the  AREIS  program.  Table  11  indicates  that  an 
overwhelming  percentage  of  soldiers  reported  no  difficulty  with  understanding 
the  content  of  the  system. 

Counselors  were  less  positive  in  responding  to  this  issue.  While  thirty- 
one  percent  felt  that  soldiers  had  no  difficulty  with  words  or  ideas;  twenty- 
five  percent  felt  that  soldiers  had  problems  with  both  words  and  concepts. 

Some  counselors  felt  that  the  soldiers  had  difficulty  moving  around  in  the 
system  and  wished  that  AREIS  could  be  simplified  and  more  menu-driven  than  is 
presently  the  case. 

Table  1 1 

Understandabi I i ty  of  AREIS 

—  ■  -  —  -  -  —  —  -  —  ■  -  -  ■  ■  -  - - -  -  -  ~  -  .  -  ..  —  .  -  .... 

Question  N  =  1050 

What  about  the  words  used  in  AREIS? 

1.  I  could  understand  everything.  92 % 

2.  I  didn't  understand  some  words.  4% 

5.  I  didn't  understand  a  lot  of  it.  4% 

Regarding  acceptance  of  the  system,  soldiers  responded  overwhelmingly  in 
the  affirmative  once  again.  Ninety-five  percent  indicated  that  they  would 
recommend  AREIS  to  a  friend.  When  asked  how  much  they  enjoyed  their  AREIS 
experience,  83J  said  that  using  AREIS  was  very  enjoyable  or  quite  enjoyable; 
only  3|  answered  in  the  negative. 
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Objective  4:  To  assess  Education  Service 
Officer  (ESO),  Education  Counselor,  and 
other  staff  reaction  to  AREIS  and  to  the 
use  of  the  computer  to  provide  career/ 
education  Information. 


At  the  end  of  the  Field  Test,  opinions  were  collected  from  the  Education 
Center  staff  by  structured  Interviews.  The  questions  dealt  with  the  accuracy, 
appropriateness,  and  completeness  of  the  content  In  the  Soldier  and  the 
COUNSELOR/ADMINISTRATOR  Subsystems,  the  level  of  usefulness  of  the 
COUNSELOR/ADMINISTRATOR  Subsystem,  and  perceptions  dealing  with  the  "best"  and 
the  "worst"  things  about  AREIS.  Due  to  the  personnel  changes  which  had  taken 
place  at  these  posts,  not  all  Counselors  who  participated  In  the  Field  Test 
were  available  to  participate  In  the  end-of-test  activities.  A  total  of 
sixteen  staff  members  took  part  In  the  Intertvew  sessions.  The  following 
Information  Is  a  summary  of  findings  elicited  through  the  Interview  process: 
slxty-nlne  percent  of  the  Counselors  reported  that  the  content  In  the  Soldier 
Subsystems  of  AREIS  Is  moderately  to  very  accurate.  There  was  less  agreement 
with  regard  to  the  COUNSELOR/ADMINISTRATOR  Subsystem.  More  than  one-third  of 
the  Counselors  did  not  want  to  answer  questions  about  the 

COUNSELOR/ ADM I NISTRATOR  Subsystem  because  they  had  not  used  the  system  enough, 
or  at  all.  More  than  one-third  of  the  staff  felt  that  the  material  was 
moderately  to  very  accurate.  (See  Table  12.) 
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Table  12 


Accuracy  of  Information  in  AREIS 


Question 

N=16 

Is  the  information  in  the  Soldier 

Subsystem  accurate: 

1 .  Very  accurate 

25$ 

2.  Moderately  accurate 

44$ 

3.  Undecided 

6$ 

4.  Somewhat  inaccurate 

6$ 

5.  Very  inaccurate 

0$ 

No  Response 

19$ 

How  accurate  is  the  information  in 
the  Counselor  Subsystem: 

1 .  Very  accurate 

13$ 

2.  Moderately  accurate 

25$ 

3.  Undecided 

13$ 

4.  Somewhat  inaccurate 

13$ 

5.  Very  inaccurate 

0$ 

No  response 

37$ 

The  structured  interview  elicited  information  about  the  appropriateness 
of  the  content  of  AREIS  and  about  the  style  of  presentation  of  the  system  for 
soldiers.  (See  Table  13.)  Sixty-nine  percent  of  the  staff  felt  that  the 
AREIS  information  was  appropriate  and  63$  felt  that  the  content  was  presented 
in  an  appropriate  manner  for  soldiers  on  the  post. 

Again,  Counselors  felt  less  sure  about  the  content  in  the 
COUNSELOR/ADMINISTRATOR  Subsystem.  Thirty-eight  percent  stated  that  the 
content  was  appropriate;  25$  were  either  undecided  or  stated  that  the  material 
was  somewhat  inappropriate.  More  than  one-third  of  the  Counselors  did  not 
respond  to  the  question. 
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Table  13 


Appropriateness  of  ARE  IS 


Question 

N  =  1  6 

To  what  extent  is  the  information  in 
the  soldier  subsystem  appropriate: 

1.  Very  appropriate 

31$ 

2.  Moderately  appropriate 

38$ 

3.  Undecided 

0$ 

4.  Somewhat  inappropriate 

13$ 

3.  Very  inappropriate 

0$ 

No  Response 

19$ 

Is  the  style  of  presentation  in  the 
soldier  subsystem  appropriate  for 
soldiers  on  your  post: 


1.  Very  appropriate  32$ 

2.  Moderately  appropriate  31$ 

3.  Undecided  13$ 

4.  Somewhat  inappropriate  6$ 

5.  Very  inappropriate  0$ 

No  response  6$ 


To 

what  extent  is  the  information  in  the 

counselor  subsystem  displayed  in  an 
appropriate  format: 

1 . 

Very  appropriate 

31$ 

2. 

Moderately  appropriate 

6$ 

3. 

Undecided 

13$ 

4. 

Somewhat  inappropriate 

13$ 

5. 

Very  inappropriate 

0$ 

No 

Response 

38$ 
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The  Counselors  felt  that  AREIS  provided  soldiers  with  a  great  deal  of 
Information.  In  responding  to  the  question,  69$  of  the  Counselors  stated  that 
AREIS  "told  soldiers  most  of  what  they  wanted  to  know,"  while  19$  said  that 
the  AREIS  content  was  Inadequate  tor  soldiers’  needs. 

Of  the  eleven  counselors  who  responded  to  a  question  about  the  usefulness 
of  the  COUNSELOR/ ADM  IN  I STRATOR  Subsystem,  eight  fe|t  that  It  was  useful,  and 
three  were  undecided.  None  of  the  Counselors  felt  Subsystem  4  to  be  "not 
useful  at  all."  Informal  comments  during  the  Interviews  Indicate  that  some 
Counselors  felt  that  the  location  of  the  computers  diminished  the  usefulness 
of  the  COUNSELOR/ADMINISTRATOR  Subsystem.  If  Counselors  had  had  access  to 
AREIS  on  or  near  their  desks,  they  might  have  used  this  part  of  AREIS  more 
frequently.  They  felt  that  they  had  paper  materials  at  their  desks  which 
would  take  no  more  time  to  search  through  than  If  they  went  to  the  AREIS 
computer  In  the  reception  area  and  called  up  the  data  they  were  seeking. 

Counselors  responded  that  the  best  thing  about  AREIS  was  the  way  that  the 
system  related  soldier  self-information  to  career  and  educational  Information 
(50$).  Twenty  percent  thought  the  machine  was  "fun  to  work  with"  and  16$ 
stated  that  AREIS  gave  soldiers  "a  lot  of  information."  The  best  parts  of 
AREIS  were  the  Interests,  Abilities,  and  Values  surveys  In  Subsystem  2  and  the 
" Getting  Promoted"  goal  In  Subsytem  5.  (See  Table  14.) 


Table  14 


Most  Helpful  Parts  of  AREIS 


N=16 

Subsystem 

N 

$ 

One: 

Subsystem  Orientation 

4 

25$ 

Two: 

Interests 

14 

aa$ 

Two: 

Abi 1 i t ies 

10 

63$ 

Two: 

Va 1 ues 

9 

56$ 

T  hree: 

Getting  Promoted 

12 

75$ 

Three: 

Developing  New  Interests 

4 

25$ 

Three: 

Getting  Some  Job  Skills 

5 

31$ 

Three: 

Completing  a  Next  Step  in  Education 

4 

25$ 

Three: 

Planning  a  Military  Career 

2 

13$ 

Three: 

Improving  MOS  Skills 

5 

31$ 

Three: 

Selecting  Another  MOS 

2 

13$ 

Three: 

Improving  Basic  Skills 

2 

13$ 

Three: 

Deciding  about  Re-enlistment 

4 

25$ 

Three: 

Making  a  Vocational  Choice 

7 

44$ 

Interviews  with  the  Counselors  indicated  that  the  hardware  problems 
clearly  had  an  impact;  36$  felt  that  the  "machine  was  broken  too  much." 

Another  36$  felt  that  the  system  had  too  much  content,  that  it  took  too  long 
for  soldiers  to  go  through,  or  that  it  was  confusing.  Of  those  choices,  the 
length  of  time  to  go  through  AREIS  was  clearly  the  issue;  on  many  occasions 
during  onsite  visits  of  project  staff.  Counselors  commented  that  the  presence 
of  mandatory  pre-use  and  post-use  evaluation  questions  in  AREIS  was  a 
hinderance  to  soldier  use  and  they  requested  that  these  questions  be  removed 
as  soon  as  possible. 

The  worst  parts  of  AREIS  in  the  opinion  of  the  staff  were  the  Orientation 
section  and  Selecting  Another  MOS.  Many  thought  the  former  was  inappropriate 
for  use  at  the  Education  Center  and  that  it  would  be  better  placed  at  the 
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inprocessing  center  or  military  personnel  of 
post  could  learn  about  the  Education  Center 
there.  (See  Table  15.)  They  felt  that  the 
information  and  a  constantly  updated  support 
specialties  which  would  necessitate  support 
Department  of  Army. 


fice  where  soldiers  new  to  the 
prior  to  their  initial  visit 
latter  needed  much  more 
database  of  military  occupational 
from  a  central  source,  probably  at 


Table  15 

Least  Helpful  Parts  of  ARE  I S 


N  =  16 


Subsystem 

N 

? 

One: 

Or  ientation 

5 

32 ? 

T  wo: 

Interests 

1 

6% 

T  wo: 

Abilities 

3 

19? 

Two: 

Values 

2 

13? 

T  nree: 

Getting  Promoted 

1 

6? 

Three: 

Developing  New  Interests 

3 

19? 

Three: 

Getting  Some  Job  Ski  1  Is 

0 

0? 

Three: 

Completeing  a  Next  Step  in  Education 

2 

13? 

Three: 

Planning  a  Military  Career 

2 

13? 

Three: 

Improving  MOS  Skills 

2 

13? 

Three: 

Selecting  Another  MOS 

4 

25? 

Three: 

Improving  Basic  Skills 

3 

19? 

Three: 

Deciding  about  Re-enlistment 

2 

13? 

Three: 

Making  a  Vocational  Choice 

3 

19? 
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OBJECT  I VE  5 :  To  assess  changes  In 
the  Education  Center  operation  as  a 
result  of  AREIS  presence. 

In  order  to  assess  changes  In  the  Education  Center  activity,  the  project 
staff  solicited  the  assistance  of  the  Counselors.  One  of  the  guidelines  of 
the  Field  Test  was  to  operate  AKEIS  in  as  true  an  operational  setting  as 
possible;  this  guideline  was  also  operative  when  It  came  to  collecting  data 
about  AKEIS  use.  Hence,  the  project  staff  utilized  the  existing  Counselor 
reporting  procedures  as  much  as  possible,  which  meant  that  the  data  collection 
device  was  not  uniform  across  the  three  Field  Test  sites.  Fort  Meade 
Counselors  use  a  computer  and  keypunch  cards  to  report  their  counseling 
activities.  Fort  Gordon  and  the  Mannheim  community  posts  use  "paper  and 
pencil"  collection  forms,  but  with  slight  differences;  Fort  Gordon  Counselors 
describe  the  counseling  activity  using  free  text,  while  Mannheim  Counselors 
use  a  check-off  system.  In  each  case,  the  existing  forms  were  amended  to 
include  the  following  data  about  the  soldier  participation  In  the  AREIS  Field 
Test: 

--  Use  of  AREIS  (check  for  either  Yes  or  No) 

—  If  not,  reason  why  not  (using  the  following  code) 

1- not  Interested 

2- not  applicable  to  Service  Member's  needs  at  current  time 

3- not  enough  time  during  this  visit 

4- do  not  like  computers 

5- computer  not  available  at  this  time 

6- other  reasons  not  1 1 sted 

—  Length  of  counseling  Interview 
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The  counseling  logs  were  screened  prior  to  the  analysis  of  the  data.  Log 
entries  were  disregarded  if  they  contained  illegible  data  or  missing  data 
elements  and  if  the  entries  represented  counseling  situations  that  took  place 
in  a  location  other  than  the  Education  Center  (e.g.,  inprocessing,  Military 
Personnel  Office,  unit  briefings.) 

A  total  of  8765  entries  were  usable.  Of  that  total,  801  soldiers 
accepted  the  AKt I S  invitation  and  used  the  system.  Almost  eight  thousand  did 
not  use  AREIS.  There  appear  to  be  several  reasons  why  ninety  percent  of  the 
soldiers  who  were  seen  by  Counselors  did  not  use  ARE  IS.  According  to  the 
logs,  the  majority  (56$)  of  these  soldiers  did  not  wish  to  use  ARE  IS  because 
it  was  not  applicable  to  their  needs  at  that  moment.  (See  Table  16.)  Twenty- 
seven  percent  did  not  have  sufficient  time  to  use  ARE  I S  during  that  particular 
visit  to  the  Education  Center.  Counselors  reported  that  many  soldiers  stated 
that  they  would  come  back  to  the  Education  Center  to  use  AREIS.  However,  the 
Counselors  were  unable  to  report  how  many  soldiers  actual  ly  did  return. 

Table  16 


Reasons 

for  Not  Using  AREIS 

1. 

not  interested 

509 

6$ 

2. 

not  app 1 i cable 

4498 

56$ 

3. 

no  time 

2188 

27$ 

4. 

do  not  1 i ke  computers 

97 

1* 

5. 

computer  not  available 

192 

2$ 

6. 

other 

480 

7$ 

The 

data  about  the  length  of 

counseling  interviews 

were  analyzed  to  see 

if  there  was  a  significant  difference  in  the  time  that  Counselors  spent  with 
AREIS  users  and  the  time  spent  with  non-users.  Figure  4  shows  the  information 
which  emerged  from  that  analysis. 
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Average  Interview  Time 
ARE  IS  Users  vs.  Non-users 


Length  of  counseling  Interview  (in  minutes) 

■  ■  Soldier  had  not  used  AREIS 
O  *  Soldier  had  used  ARE IS 


During  the  structured  Interview  conducted  at  the  close  of  the  Field  Test 
Counselors  reported  that  their  average  interview  time  is  approximately  twenty 
minutes.  The  counseling  logs  show  that  83?  of  non-users  had-  interviews  of 
twenty  minutes  or  less  and  17?  had  Interviews  of  twenty-five  minutes  or  more; 
73?  of  ARE  I S  users  spent  twenty  minutes  or  less,  while  26?  spent  twenty-five 
minutes  or  more.  From  these  data,  then,  it  would  appear  that  AREIS  users 
require  a  longer  amount  of  time  with  their  Counselors  than  do  non-users, 
although  the  difference  Is  not  significant. 

A  third  element  of  the  counseling  session,  the  content  or  educational 
activity,  was  also  analyzed.  A  sub-set  of  the  counseling  logs  was  used  to 
collect  these  data.  Three  hundred  randomly  selected  entries  dealing  with 


«KtlS  users  were  compared  against  three  hundred  randomly  selected  entries 
dealing  with  non-users.  Tade  17  depicts  the  breakdown  of  activities  as  shown 
by  the  anal ys I s. 


Table  17 

Analysis  of  Counseling  Activity  By  ARE  IS  Users  and  Non-Users 


ARE  1 S  Users 

Non-Users 

%  counseled*  jfenrol  ledg 

^counseled  Jenrol led 

BSEP** 

2 

3 

5 

2 

T.A. 

13 

1 

1  1 

0 

college 

7 

1 

9 

2 

BASIC  MATH/SCI 

0 

0 

1 

0 

OCS/KOTC 

3 

0 

1 

0 

CLEP 

7 

1 

7 

2 

AAP 

1 

2 

2 

4 

GED 

4 

6 

4 

13 

COURSES 

6 

3 

9 

2 

TESTING 

6 

0 

5 

1 

VA/VEAP 

3 

2 

7 

1 

GEN'L  INFO 

transcript 

4 

0 

1 

0 

EVALUATION 

11 

0 

6 

0 

ASVAB 

3 

1 

3 

1 

IfPROC'G 

1 

0 

3 

0 

SOCAD 

0 

0 

1 

0 

ARE  IS 

1 

9 

0 

0 

71 1 

29* 

73* 

~Tf% 

*  counseled  =  the 

program  was 

discussed  only  and  no 

concrete 

act  Ion 

was  taken 

H  enrol  led  =  the 

serv 1 cemember 

was  actually  enrolled 

In  the 

program 

during  th 

counseling  session  or  saw  the  Counselor  with  the  specific  goal  of 


enrolling  In  the  program. 

••See  Appendix  D  for  definitions  of  acronyms  and  abbreviations. 


These  data  show  that  there  is  relatively  little  difference  in  the  scope 
of  counseling  activities  that  involves  Counselors  and  their  clients.  The 
Counselors  confirmed  this  perception  during  the  structured  Interviews.  When 
asked  how  the  presence  of  ARE  I S  had  changed  their  roles  as  Counselors,  most 
Counselors  felt  that  AREIS  had  not  made  a  significant  change.  Frcm  the 
current  Field  Test  data,  there  is  no  way  to  ascertain  why  more  AREIS  users 
requested  transcript  evaluation  or  why  more  non-AREIS  users  enrolled  in  the 
GED  program.  Further  tests  must  be  done  to  analyze  the  effect  of  AREIS  use  on 
the  subsequent  Education  Center-related  actions  of  soldiers.  There  Is  also  no 
way  to  get  Information  about  the  AREIS  listing  at  the  bottom  of  the  table.  A 
possible  explanation  could  be  that  a  Counselor  recorded  positive  and  negative 
soldier  responses  to  his/her  invitation  to  use  AREIS  and  these  figures  were 
picked  up  through  the  random  selection  of  Counselor  log  entries. 

It  Is  Important  to  note  here  that  most  Counselors  counseled  with  their 
clients  before  they  Invited  them  to  use  the  AREIS  program,  rather  than  after 
AREIS  use.  It  Is  possible,  therefore,  that  the  data  would  have  been  different 
had  soldiers  used  AREIS  prior  to  their  counseling  sessions.  There  Is  also 
some  reason  to  question  the  accuracy  of  the  data  on  many  of  the  counseling  log 
sheets.  It  appears  that  some  of  the  Information,  In  particular  the  data  Items 
dealing  with  reason  for  non-use  of  AREIS  and  the  length  of  the  counseling 
session,  on  some  of  the  log  sheets  may  have  been  entered  at  one  time  during 
the  month  rather  than  at  the  end  of  each  counseling  session.  On  one  set  of 
counseling  log  sheets,  tor  example,  forty  eight  entries  out  of  fifty  were 
marked  with  the  same  code,  and  all  counseling  sessions  were  twenty  minutes  in 
length.  This  kind  of  entry  pattern  existed  on  many  Counselor  logs.  This 
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Information,  coupled  with  the  fact  that  many  Counselors  did  not  ask  soldiers 
prior  to  the  counseling  session  If  they  would  like  to  use  AREIS,  places  the 
veracity  of  these  data  In  jeopardy. 


Summary 

The  findings  from  the  Field  Test  are  summarized  as  follows: 

1.  Most  parts  of  the  AREIS  software  operated  In  an  acceptable  manner  during 
the  Field  Test.  Some  of  the  AREIS  software  requires  modification  before 
It  can  be  considered  ready  for  Army-wide  distribution.  Portions  of  the 
text  which  deal  with  ACES  programs,  promotion  procedures,  and  with 

ml  I  I tary/c I v I  1 1  an  crosswalks  need  to  be  expanded  and  updated.  The 
abilities  section  In  Subsystem  2,  SELF-INFORMATION  will  require 
reprogramming  of  the  Interpretation  process  If  It  I s  to  be  used  as  a  part 
of  the  ARE  IS  program  In  the  future. 

2.  The  operation  of  the  APPLE  and  DISCOVERY  multi-user  machines  which  were 
placed  In  the  Education  Centers  must  be  considered  as  generally 
unreliable.  Each  of  the  machines  experienced  some  kind  of  failure  during 
the  field  test:  In  Germany  the  machine  failed  twice  and  was  out  of 
service  for  approximately  two  months  of  the  nine-month  field  test;  at  Fort 
Gordon  there  were  recurring  problems  with  getting  all  three  terminals  to 
operate;  at  Fort  Meade  the  system  generated  "string  too  long"  messages  and 
sometimes  dropped  the  user  out  of  AREIS  back  to  the  the  operating  system 
level.  Counselors  were  psychologically  and/or  experiential  I y  unprepared 
for  hardware  problems.  Telephone  communication  was  not  an  effective 
method  for  diagnosis  and  remediation  of  hardware  problems.  Before  micro¬ 
computers  are  Installed  In  an  Education  Center,  a  service  contract  with  a 
local  company  should  be  secured  to  provide  quick  repair. 


3.  Soldiers  who  opted  to  use  AREIS  found  the  system  to  be  easy  to  understand 
and  enjoyable  to  use.  They  felt  very  positive  about  using  AREIS  for 
career  and  educational  planning.  Subsystem  2,  SELF- 1  INFORMATION,  was 
considered  to  be  the  most  helpful  part  of  the  system.  This  finding 
verified  the  findings  of  the  previous  limited  field  tryout  of  AREIS  and 
also  the  findings  of  research  done  on  civilian-oriented  computer-based 
systems.  Soldiers  showed  little  movement  toward  the  specification  of 
career  and  educational  planning  as  a  result  of  using  AREIS.  Most  used 
AREIS  only  one  time;  however,  those  soldiers  who  used  AREIS  more  than  one 
time  showed  some  slight  movement  toward  career  and  educational  decision 
making.  Some  others  made  tentative  plans  based  upon  their  AREIS 
exploration  activities.  These  findings  support  the  theory  that  a 
computer-based  Information  system  has  the  capability  to  help  users  narrow 
or  broaden  their  career  and  education  choices. 

4.  Counselors  generally  expressed  positive  feelings  about  the  use  of  a 
computer  to  deliver  career  and  educational  planning  information.  Many 
Counselors  felt  that  soldiers  who  had  used  AREIS  prior  to  the  counseling 
session  had  more  specific  questions  about  career  and  educational  planning. 
Many  Counselors  were  concerned  about  the  length  and  understandabl 1 1  ty 

of  the  system,  however,  and  felt  that  the  design  of  AREIS  should  be 
modified  to  make  It  more  flexible. 

5.  Counselors  continued  to  be  the  primary  providers  of  career  and  educational 
information.  The  existence  of  AREIS  within  the  Education  Center  setting 
made  no  measurable  difference  in  the  amount  of  time  which  Counselors 
spend  with  clients  or  In  the  kinds  of  counseling  activities  which 

take  place  during  the  counseling  session. 
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RECOMMENDATIONS  FOR  THE  ARMY-WIDE  DISSEMINATION 


This  section  provides  recommendations  for  the  revision  of  the  current 
AREIS  software  and  hardware  and  for  the  distribution  of  AREIS  to  Education 
Centers  worldwide. 


Future  Development  of  AREIS  Content 

Project  staff  received  a  number  of  suggestions  from  Education  Counselors, 
ESO's,  Field  Test  Coordinators,  and  Education  Directorate  personnel  for  the 
modification  or  enhancement  of  the  AREIS  software.  These  suggestions,  along 
with  recommendations  emanating  from  the  field  test  experience.  Include: 

1.  Increasing  the  size  and  scope  of  the  AREIS  occupational  data  file. 

AREIS  currently  contains  a  data  file  of  417  occupations  and  provides 
Information  about  work  tasks,  work  setting,  educational  requirements,  and 
related  military  occupations.  This  data  file  could  be  expanded  to  provide 
Information  about  newly  emerging  occupations  and  about  other  occupations 
which  have  counterparts  In  the  military  setting.  For  example,  there 
are  few  civilian  occupations  In  the  file  which  relate  to  signal  or 
electronics  occupations.  In  1982,  the  Department  of  Defense  funded 
a  project  to  provide  Information  on  m 1 1 1 tary/c I vl 1 1  an  occupational 
crosswalks.  This  project  should  be  considered  as  a  resource  If  the  data 
file  Is  expanded.  AREIS  can  also  be  expanded  to  Include  job  descriptions 
about  MOS's  just  as  It  does  for  the  civilian  occupations.  Such 
Information  on  work  tasks  and  related  education  requirements  would  be 
beneficial  to  the  military  career  declslon-makl ng  of  Army  personnel. 
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2.  The  content  of  the  entire  system  should  be  reviewed  for  relevancy, 
currency,  and  accuracy.  Many  Army  policies  and  regulations 
governing  ACES  programs  have  changed  since  the  ARE  IS  scripts  were 
written.  This  situation  can  cause  confusion  on  the  part  of  AREIS 
users.  The  Promotion  Procedure  section  needs  review,  for  example, 
to  bring  the  calculation  of  promotion  points  up  to  date  and  to 
discuss  in  more  detail  automatic  promotion  for  ranks  E2  to  E4. 

Some  portions  of  AREIS  might  be  removed  from  the  system.  The  goal, 
"Developing  New  Interests,"  for  example,  was  considered  one  of 
the  least  helpful  modules  by  counselors.  This  particular  goal  requires 
the  entry  of  information  about  community  activities  available  on 
post.  It  is  possible  that  budget  cuts  in  the  community  activity  area 
have  severely  reduced  the  number  and  variety  of  options  available  to 
soldiers  to  develop  interests  in  new  areas.  Hence,  the  in  format  1 
provided  might  be  too  scanty  to  be  helpful  to  the  AREIS  user.  Some 
scripts,  such  as  the  section  on  the  Army  Apprenticeship  Program,  should 
be  expanded  to  include  more  specific  information.  The  system  might  also 
be  expanded  to  include  specific  information  about  training  materials 
found  in  the  MOS  libraries  and  Learning  Centers.  Care  must  be  exercised 
to  insure  that  the  information  provided  here  is  consistent  across  the 
whole  range  of  Army  posts;  otherwise  an  expanded  author  language  must  be 
provided  to  allow  for  local  input  of  data. 
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3.  Careful  consideration  must  be  given  to  the  retention  or  reprogramming  of 
the  SELF-INFORMATION  Sub  system.  The  Interest,  Abilities,  and  Values 
surveys  which  are  presently  programmed  in  AREIS  are  copyrighted 
instruments.  The  American  College  Testing  Program  (ACT)  allowed  royalty- 
free  use  of  these  instruments  for  the  duration  of  Contract  MDA  903-81-C- 
0569.  At  the  conclusion  of  this  contract,  any  sites  wishing  to  use  these 
instruments  must  pay  a  royalty  to  ACT.  These  copyrighted  inventories 
could  be  replaced  with  Army-developed  instruments  which  would  require  no 
royalty.  Occupations  in  the  data  tile  would  have  to  be  related  to  the 
results  of  the  new  interest  inventory  so  that  users  could  obtain  civilian 
as  well  as  military  occupations  which  relate  to  their  interest  profiles. 

4.  The  issue  of  flexibility  of  movement  through  the  system  should  be 
reviewed.  AREIS  is  currently  programmed  to  allow  a  user  to  return  to  the 
main  menu  from  almost  any  frame  in  the  system.  The  "escape"  feature 
should  be  included  on  every  frame.  AREIS  might  also  be  programmed  to 
include  new  menus;  for  example,  a  menu  of  AREIS  topics  related  to  each 
educational  level  might  serve  to  focus  users  in  on  topics  which  relate  to 
their  educational  aspirations.  This  capability  could  reduce  the  amount  of 
time  needed  to  interact  with  the  whole  AREIS  system. 

5.  The  author  language  which  allows  localization  of  information  should  be 
expanded  and  made  more  "user-fr iend i y The  current  system  does  not 
include  enough  frames  for  the  master  schedule;  that  section  should 
provide  for  an  unlimited  number  of  frames  as  long  as  a  hard  disk  is  used 
to  store  the  program. 
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Hardware  and  Software 


When  the  current  development  project  began  in  1981  microcomputer 
technology  was  limited  to  a  relatively  small  number  of  machines  which  could 
provide  the  capabilities  required  by  AREIS  (e.g.  multi-user,  large  data  file 
storage,  50-cycle  current).  For  example,  the  Apple  microcomputer  was  not 
designed  as  a  multi-user  machine;  hence  another  piece  of  hardware,  a 
multiplexor,  had  to  be  Interfaced  between  the  hard  disk  and  the  computers  to 
effect  the  multi-user  capability.  There  was  no  commonly  used  way  to  enable  the 
print  capability  for  a  multi-user  configuration  and  so  a  printer  switch  box 
also  had  to  be  added  to  the  configuration.  At  that  point  the  operating  system 
which  was  commonly  used  for  large  computer  programs  with  large  supporting 
databases  was  CP/M.  This  software  was  not  designed  to  be  multi-user;  hence 
some  changes  to  CP/M  were  made  by  the  hardware  vendors  who  wanted  to  run  CP/M 
on  their  multi-user  machines;  this  CP/M,  then,  was  no  longer  generic. 

Today  the  microcomputer  Is  becoming  the  most  widely  used  form  of 
computer.  This  method  of  delivery  appears  to  be  the  most  viable  approach  for 
Education  Centers  today,  despite  the  problems  encountered  during  the  Field 
Test.  An  Important  consideration  Is  the  relative  low  cost  of  the 
microcomputer.  Education  Centers  will  be  able  to  afford  these  machines  and 
their  software.  The  Issues  of  flexibility  and  control  are  also  Important  to 
the  Individual  Education  Center.  The  microcomputer  is  the  delivery  mode  which 
best  meets  these  criteria. 

Hardware  Is  now  being  released  which  Is  specifically  designed  to  handle 
the  mu|tl-user  capability.  Operating  systems  such  as  UNIX  have  also  been 
developed  to  meet  this  need.  Hence,  hardware  and  software  available  today  are 
much  more  compatible  with  the  needs  of  the  AREIS  system.  Serious 
consideration  should  be  given  to  the  question  of  need  for  a  multi-user 
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system.  The  Field  Test  experience  casts  doubt  on  the  need  for  a  multi-user 
configuration,  even  at  large  Education  Centers.  Not  every  soldier  who  visits 
the  tducatlon  Center  has  the  time  or  t he  Inclination  to  use  a  system  like 
ARElS.  Education  Centers  on  Army  posts  do  not  perform  the  same  function  as  a 
high  school  guidance  office.  For  example,  soldiers  who  visit  the  Education 
Center  generally  have  a  specific  topic  in  mind  and  just  enough  time  to  take 
care  of  it;  hence,  the  need  for  several  ccmputers  to  deliver  a  system  like 
ARE  I  S  may  not  be  as  great  In  the  military  setting  as  It  might  be  in  the 
secondary  school  setting. 

There  are  many  microcomputers  available  today  which  enjoy  widespread 
acceptance  because  they  are  reliable  and  easy  to  operate.  The  IBM-PC,  for 
example,  has  become  the  Industry  standard  In  a  very  short  period  of  time 
because  of  the  corporation  and  the  widespread  support  facilities  which  stand 
behind  It.  The  support  Issue  Is  very  Important  to  Counselors;  the  need  to 
have  local  repair  facilities  Is  critical  to  the  success  of  a  computer  system 
In  an  Education  Center. 

Selection  of  an  easy-to-understand-and-use  operating  system  Is 
Important.  By  using  an  operating  system  which  is  generic  and  native  to  the 
hardware,  ARElS  would  be  easier  and  less  expensive  to  Implement  and  run.  An 
example  of  an  operating  system  which  Is  native  to  a  machine  is  PC  DOS.  This 
operating  system  Is  distributed  with  each  IBM  microcomputer;  hence  the  user 
site  would  not  have  to  make  a  separate  purchase  of  an  operating  system  to 
drive  the  software  program. 

The  Issue  of  hard  disk  storage  versus  floppy  disk  storage  should  also  be 
closely  Investigated.  The  advantages  of  the  hard  disk  system  are 

o  once  Installation  Is  complete,  users  do  not  have  to  handle 


or  change  the  storage  media 


I 

o  a  greater  amount  of  storage  space  is  available  for  the  software 
program  and  user  records 

o  user  records  can  be  stored  over  a  period  of  time 
o  more  than  one  software  program  can  be  installed  if  space  allows 
The  disadvantages  are 

o  the  hard  disk  is  more  sensitive  to  movement  and  to  fluctuation  of 

electrical  current.  Should  a  problem  occur,  the  whole  program  might  be 
I  ost 

a 

o  higher  cost  than  floppy  disk  drives  and  flexible  storage  media 
The  advantages  to  the  floppy  disk  system  are 

o  a  large  number  of  programs  can  be  run  using  floppy  disks;  hence  the 
computer  may  have  more  flexibility  of  use 
o  lower  cost  to  purchase  and  maintain  (floppies) 
o  flexibility  of  options  in  the  software  program;  that  is,  if 

implemented  in  this  fashion.  Education  Centers  could  purchase  desired 
modules  of  ARE  I S  instead  of  the  entire  program 
The  disadvantages  are 

o  no  long-term  storage  of  user  records 

o  increased  handling  of  media  which  may  result  in  problems  with  the 
display  of  correct  data 

Any  new  development  should  also  include  the  use  of  color  and  graphics 
capability.  The  use  of  color  would  enhance  the  visual  impression  created  by 
AREIS.  Graphics  could  increase  understanding  of  certain  concepts  (e.g.  the 
Wor I d-of-Work  Map  in  the  current  version;  improved  operating  instructions  in  a 
new  version).  Another  technological  advance  which  would  greatly  enhance  the 
delivery  of  AREIS  is  the  computer-controlled  videodisk.  This  machine  could 
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strengthen  the  delivery  of  occupational  Information  by  presenting  pictures  of 
work  tasks  and  work  settings  along  with  the  textual  descriptions.  The  Army 
has  a  vldeodlsk  system  currently  In  operation  called  the  Joint  Optical 
Information  Network,  JOIN.  ARE  1 S  could  posslDly  be  integrated  into  the  JOIN 
system. 


Operational  Environment 

Microcomputer  technology  requires  no  special  environment.  Any  room  where 
humans  can  exist  comfortably  Is  acceptable  to  the  microcomputer.  That  does  ** 

not  mean,  however,  that  no  special  care  needs  be  taken  to  protect  the  machine 
and  the  software.  The  electrical  power  supply  in  the  Education  Centers  should 
be  carefully  checked  and  monitored  to  assure  proper  operation  of  the  hardware 
and  to  protect  the  software.  Some  Education  Centers  are  old  buildings  and 
lack  new  electrical  wiring.  Power  surge  protectors  can  be  Installed  between 
the  computer  and  the  electrical  outlet  which  will  help  to  minimize  electrical 
problems.  Also,  ml crocomputers  should  be  kept  clean  and  tree  of  dirt  and 
dust.  Dirt  In  the  cooling  system  can  create  a  heat  bultd-up  which  can  damage 
disks.  Staff  should  be  trained  In  periodic  maintenance  of  the  equipment  In 
order  to  prevent  problems  caused  by  excessive  dirt  and  dust. 

Location  of  the  computer  Is  another  Important  consideration.  The  system 
should  be  placed  In  an  area  where  the  computer  Is  visible  and  accessible  to 
soldiers.  It  should  also  be  a  location  that  offers  some  degree  of  privacy. 

However,  If  Counselors  are  to  use  the  system  as  an  adjunct  to  their  counseling 
activity,  the  computer  must  be  located  near  their  offices.  AREIS  has  utility 
In  other  areas  on  post  as  well.  The  ORIENTATION  Subsystem  might  be  used  at 
the  (nprocesslng,  or  welcome  center.  Subsystem  3  may  be  beneficial  at  the 
Military  Personnel  Office  or  In  the  MOS  library  or  Learning  Center. 
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System  Maintenance 


Certain  functions  regarding  AREIS  operation  would  need  to  be  initiated  at 
the  Education  Directorate  level  if  AREIS  is  to  be  supported  successfully. 

These  functions  include: 

1.  the  development  of  general  policy  with  regard  to  AREIS  use  in  the 
Education  Centers 

2.  annual  review  of  AREIS  text  and  data  files  and  distribution  to  all 
AREIS  sites 

3.  continued  monitoring  of  technical  developments  which  might  enhance 
the  cost  effectiveness  of  the  system 

4.  development  of  policy  regarding  acquisition  of  new  material  to  be 
used  in  ARE  I S  and  royalty  payment  for  use  of  copyrighted 
materials  currently  used  in  AREIS 

Other  functions  should  be  carried  out  at  the  Education  Center  level. 

They  include: 

1.  arrangement  for  the  purchase  or  lease  of  computer  equipment  to 
operate  AREIS 

2.  arrangement  for  a  service  contract  for  repair  of  the  hardware 

3.  selection  of  an  onsite  AREIS  Coordinator  who  has  primary 
responsibility  for  the  AREIS  project 

4.  determination  of  information  about  local  post  educational 
offerings  which  can  be  included  in  AREIS 
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5.  determination  of  location  of  the  computer  and  decision  as  to  use 
of  the  system  In  other  locations  on  post 

6.  selection  and  training  of  data  entry  personnel 

7.  coordination  of  publicity  programs  about  AREIS 

8.  coordination  of  (nservlce  training  of  all  personnel  when  AREIS 

Is  Implemented,  and  training  of  personnel  who  begin  working  in  the 

Education  Center  after  AREIS  has  Deen  integrated  Into  the  program. 

Support  Services 

Inservfce  training  for  all  Education  Center  personnel  Is  critical  to  the 
successful  Integration  of  AREIS  Into  the  ongoing  counseling  program. 
Counselors  and  other  staff  should  have  knowledge  of: 

o  the  conceptual  design,  theoretical  basis,  and  content  of  AREIS 

o  the  operation  of  the  computer  and  Its  peripheral  equipment 

o  the  localization  function  and  how  to  operate  It 

o  possible  ways  of  infusing  AREIS  into  the  ongoing  counseling  program 

Staff  should  also  participate  In  a  hands-on  experience  so  that  they  can 
operate  the  system  successfully. 

Because  of  the  frequent  moves  by  Education  Center  personnel ,  the  concept 
of  onsite  Inservlce  Training  by  ARE  I S-re I ated  personnel  Is  perhaps 
Impractical.  A  videotape  presentation  which  covers  the  design,  theory,  and 
content  of  each  subsystem,  combined  with  hands-on  experience  may  provide  a 
solution  to  this  problem.  The  Inservlce  Training  Guide  which  has  been 
developed  during  this  project  can  provide  support  for  both  these  approaches. 
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The  Counselor  Guide,  User  Guide,  and  Technical  Guide  should  be  modified 
in  accordance  with  any  revision  of  the  AREIS  program  or  the  hardware  on  which 
it  will  be  implemented.  These  guides  are  integral  to  the  support  of  AREIS  and 
should  be  kept  up  to  date  and  available  for  easy  reference. 

Continuous  publicity  of  the  availability  of  AREIS  will  be  instrumental  in 
the  effectiveness  of  the  program.  Publicity  can  take  place  in  daily 
bulletins;  post  newspapers;  posters  in  highly  visible,  wel I -popu I ated  and 
highly  trafficked  areas;  spot  ads  on  post  television  or  radio  stations;  and 
word  of  mouth. 

CONCLUSION 

This  document  has  provided  a  review  of  the  development  of  AREIS.  It  has 
also  summarized  Counselor  and  soldier  reactions  to  AREIS  during  a  nine-month 
field  test.  Soldiers  expressed  positive  attitudes  about  AREIS,  while 
Counselors  were  more  cautious.  Considerable  difficulties  with  the  hardware 
were  observed.  Recommendations  are  offered  for  revisions  of  AREIS  and  for 
requirements  for  further  development  and  distribution. 
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APPENDIX  A 


PRE-USE  QUEST IONNAIKE  AND  ANALYSIS 


Rank 


1. 

E2 

2. 

E3 

3. 

E4 

4. 

E5 

5. 

E6 

6. 

E7 

7. 

E8 

8. 

E9 

9. 

Warrant  Officer 

10. 

Of  f icer 

1  1. 

Educat i on 

Center  Counselor 

12. 

Education 

Services  Officer 

13. 

Other 

Sex 

Fema 1 es 

Ma  1  es 

Total 

Percent 

1 44 

>3* 

214 

19* 

254 

23% 

194 

17* 

123 

1  1* 

46 

4* 

23 

2* 

5 

<  i* 

15 

i* 

32 

3* 

12 

i* 

1 

<  i* 

51 

5* 

1,114 

99* 

212 

20* 

902 

80* 

1,114 

100* 

61 


1.  Enter  time  in  service  to  nearest  year 


Total 

Percent 

0 

50 

4$ 

1 

290 

26$ 

2 

122 

i  i$ 

3 

1  19 

11$ 

4 

86 

8$ 

5 

70 

6$ 

6-10 

220 

20$ 

11-15 

72 

66$ 

16-20 

39 

4$ 

21-25 

3! 

3$ 

26-30 

10 

1$ 

30  or  more 

5 

<  1$ 

1  ,  t  14 

100$ 

2.  Enter  time 

in  grade  to  nearest  year 

0 

70 

6$ 

1 

502 

45$ 

2 

208 

19$ 

3 

107 

10$ 

4 

69 

6$ 

5 

64 

6$ 

6 

25 

2$ 

7 

14 

1$ 

8 

13 

1$ 

9 

7 

1$ 

10 

12 

1$ 

1  1-15 

14 

1$ 

16-20 

4 

1$ 

21-25 

2 

<  1$ 

26-30 

1 

<  1$ 

30  or  more 

2 

<  1$ 

1,114 

99$ 

3.  How  long  have  you  been  at  this  post  (in  months) 


0 

36 

3$ 

1 

192 

17$ 

2-6 

375 

34$ 

7-12 

209 

19$ 

13-18 

104 

9$ 

19-24 

67 

6$ 

25-30 

48 

4$ 

31-36 

34 

3$ 

37-42 

16 

1$ 

4  3-48 

14 

1$ 

49-60 

13 

1$ 

6 1  or  more 

6 

1$ 

1,114 

~9^ 
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4. 

0 

1 

2 

3 

4 

5 

e 

7 

8 

9 

10 
15 
20 
25 
40 
100 


How  many  times  have  you  used  the  Education  Center? 

Total 

158 

322 

154 

104 

81 

79 

23 

16 

14 
7 

75 

23 

27 

15 
6 

10 

TTTTT 


Percent 

14$ 

29$ 

14$ 

9$ 

7$ 

7$ 

2$ 

1* 

1$ 

1$ 

7$ 

2$ 

2$ 

1? 

If 

1$ 

99$ 


5.  At  this  point,  1  have: 

1.  No  idea  about  my  future  vocational 
plans. 

151 

14$ 

2.  Some  vague  idea  about  my 
future  vocational  plans. 

351 

32$ 

3.  Narrowed  future  plans  to 

2  or  3  choices. 

412 

37$ 

4.  Narrowed  future  plans  to 

1  certain  vocation. 

200 

1,114 

18$ 

101$ 

6.  At  this  point,  1  have: 

1.  No  idea  about  my 
educational  plans 

107 

10$ 

2.  Some  vague  ideas  about 
my  educational  plans 

366 

33$ 

3.  Narrowed  my  educational 
plans  to  1  or  2  possible 
types  of  training 

439 

39$ 

4.  Selected  one  program  for 
more  education  or 
training 

202 

1,1 14 

18$ 

Too? 

rounding  error  may  distort  the  exact  percentage  total 
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For  help  with  my  job  planning,  a  computer  would  be: 


Total 

Percent 

1. 

Very  useful 

604 

54$ 

2. 

Use  f  u  1 

327 

29$ 

3. 

Undec  i  ded 

162 

15$ 

4. 

Not  very  useful 

10 

1? 

5. 

Not  at  al 1  useful 

1 1 

\% 

1,114 

100$ 

For 

help  with  my  educational 

plann i ng. 

a  computer  would  be: 

1. 

Very  useful 

600 

54$ 

2. 

Useful 

34  5 

31$ 

3. 

Undec i ded 

148 

13$ 

4. 

Not  very  useful 

9 

1$ 

5. 

Not  at  a  1 1  usef u 1 

12 

1$ 

1,114 

w 

APPENDIX  B 


POST-USE  QUESTIONNAIRE  AND  ANALYSIS 
Number  of  times  on  system 


I 

r 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


Modules  Used  (More  than 


0 

1 

2 
3 


Part  3 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


Total 


1  14 
65 
229 
59 
121 
288 


2,627 


Questions 

1.  How  useful  was  your  use  of  ARE1S? 


1. 

Very  useful 

850 

2. 

Quite  useful 

323 

3. 

Moderately  useful 

232 

4. 

Not  useful  at  al 1 

132 

5. 

Not  useful 

93 

1,630 


•Rounding  error  may  distort  the  exact  percentage 

65 


Percent 


1,168 

72$ 

261 

16$ 

99 

6$ 

49 

3$ 

23 

1$ 

13 

1$ 

8 

<  1$ 

3 

<  1$ 

2 

<  1$ 

4 

<  1$. 

1  ,630 

99$ 

1  answer) 

73 

2$ 

1  ,545 

4  3$ 

1,052 

29$ 

933 

26$ 

57603 

100$ 

than  1  answer) 

724 

28$ 

336 

13$ 

169 

6$ 

195 

7$ 

327 

12$ 

4? 

2$ 

9% 

2% 

5$ 

US, 


99% 


52$ 

20$ 

14$ 

8$ 

6$ 


100$ 


I 


How 

enjoyable  was  your  use  of  ARE  IS? 

Total 

Percent 

1. 

Very  enjoyable 

987 

6  1$ 

2. 

Qui te  enjoyable 

366 

22% 

3. 

Moderately  enjoyable 

167 

10$ 

4. 

Somewhat  enjoyable 

75 

5$ 

5. 

Not  enjoyable  at  all 

45 

3$ 

1,630 

101$* 

Which  part  of  ARE  IS  was  the  most  useful  to 

you? 

I. 

Orientation  (Part  1) 

401 

25% 

2. 

Se 1 f- Informat  ion  (Part  l|) 

724 

44$ 

3. 

Goals  &  Planning  (Part  III) 

505 

31$ 

1,630 

100* 

Which  part  of  ARE  IS  was  the  most  interest i 

ng  to  you? 

1 , 

Orientation  (Part  1) 

405 

25$ 

2. 

Se 1 f- Information  (Part  II) 

718 

44$ 

3. 

Goals  &  Planning  (Part  III) 

507 

31$ 

1,630 

100$ 

What  about  the  words  used  in  ARE  IS? 

1 . 

1  could  understand  everything 

1,486 

91$ 

2. 

1  didn't  understand  some  words 

sentences 

85 

5$ 

3. 

1  didn't  understand  a  lot  of  it 

59 

4$ 

1,630 

100$ 

Did 

you  have  any  of  these  problems? 

1. 

Trouble  with  the  computer 

182 

11$ 

2. 

Directions  for  using  the 

computer  were  not  clear 

42 

3$ 

3. 

Direction  for  using  ARE  IS  were 

not  clear 

33 

2$ 

4. 

1 t  was  bor i ng 

51 

3$ 

5. 

No  problems 

1,322 

81$ 

1,630 

100$ 

# 


Rounding  error  may  distort  the  exact  percentage 


66 


9 


* 


» 


7.  Would  you  recommend  ARE  1 S  to  a  friend? 

1 . 

Yes 

1,541 

95? 

2. 

No 

89 

5? 

1,630 

100? 

8.  What  have  you  done  since  you  last  used  ARE  1 

IS?  (More  than 

1  answer 

1. 

Talked  to  a  counselor 

299 

18? 

2. 

Talked  to  my  unit  officer, 

sergeant  or  milpo  staff  member. 

46 

3? 

3. 

Read  more  information  about  a  job 

101 

6? 

4. 

Signed  up  for  a  course 

1 16 

7? 

5. 

None  of  the  above 

224 

13? 

6. 

Nothing!  This  is  my  first  use! 

884 

53? 

1  ,670 

100? 

9.  At 

this  point,  1  have: 

1. 

No  idea  about  my  future  voca¬ 

tional  plans. 

219 

13? 

2. 

Some  vague  ideas  about  my  future 

vocational  plans 

506 

31? 

3. 

Narrowed  future  plans  to  2  or  3 

choices 

609 

37? 

4. 

Narrowed  future  plans  to  1  certain 

vocation . 

296 

18? 

1  ,630 

99? 

10.  At 

this  point,  1  have: 

l. 

No  idea  about  my  educational 

p  1  ans 

205 

13? 

2. 

Some  vague  ideas  about  my  educa¬ 

tional  plans 

479 

29? 

3. 

Narrowed  my  educational  plans  to 

1  or  2  possible  types  of  training 

659 

40? 

4. 

Selected  one  program  for  more 

education  or  training 

287 

18? 

7,630 

1W 

Rounding  error  may  distort  the  exact  percentage 
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i 


11.  For  help  with  my  job  planning,  a  computer  would  be: 

1.  Very  useful 

2.  Useful 

3.  Undecided 

4.  Not  very  useful 

5.  Not  at  a  I  I  useful 


12.  For  help  with  my  educational  planning,  a  computer  would  be: 


1,010 

62$ 

394 

24$ 

133 

8$ 

40 

2$ 

53 

3$.. 

r,o3o 

—59$* 

1.  Very  useful 

2.  Useful 

3.  Undecided 

4.  Not  very  useful 

5.  Not  at  al I  useful 


993 

427 

123 

38 

49 

■TOo 


6 1  % 
26$ 
8$ 
2$ 

_ 3$ 

~160$ 


* 

Rounding  error  may  distort  the  exact  percentage 
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APPENDIX  C 


STRUCTURED  INTERVIEW  FOR  COUNSELORS 


Please  answer  the  following  questions  as  honestly  as  possible.  The 
information  you  provide  will  be  confidential.  Most  responses  will  be  used  in 
the  aggregate.  Individual  comments  may  be  used  within  the  Field  Test  Report. 
The  comments  will  be  used  for  research  purposes  only  and  wilt  not  be 
associated  with  individual  ESO's  or  Counselors. 


The  following  questions  relate  to  the  Soldier  Subsystem: 

I.  Is  the  information  in  the  Soldier  Subsystem  accurate? 

1.  Very  accurate 

2.  Moderately  accurate 

3.  Undecided 

4.  Somewhat  inaccurate 

5.  Very  inaccurate 
No  Response 

Comment : 


N=1 6 


25 

44 

6 

6 

0 

19 

100? 


2.  To  what  extent  is  the  information  in  the  Soldier  Subsystem  appropriate? 


N=  1 6 


# 

% 

1.  Very  appropriate 

5 

31 

2.  Moderately  appropriate 

6 

38 

3.  Undecided 

0 

0 

4.  Somewhat  inappropriate 

2 

13 

5.  Very  inappropriate 

0 

0 

No  Response 

3 

19 

Comment: 

16 

101?* 

3.  In  general,  is  the  style  of 

presentation 

in  the  Soldier  Subsystem 

appropriate  tor  soldiers  on  your 

post? 

N= 

16 

# 

% 

1.  Very  appropriate 

6 

38 

2.  Moderately  appropriate 

6 

38 

3.  Undecided 

2 

13 

4.  Somewhat  inappropriate 

1 

6 

5.  Very  inappropriate 

0 

0 

No  Response 

1 

6 

Comment: 

16 

i3TT* 

•Total  %  may  exceed  100?  due  to  rounding. 
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4 .  The 

information  in  AREIS 

N  = 

16 

# 

$ 

1. 

Told  soldiers  everything  they  wanted  to 

know 

0 

0 

2. 

Told  soldiers  most  of  what  they  wanted 

to  know 

1  1 

69 

3. 

Was  inadequate 

3 

19 

4. 

Told  soldiers  more  than  they  wanted  to 

know 

1 

6 

5. 

1  don't  know 

1 

6 

No  Response 

0 

0 

16  100$ 


Comment : 


16  100$ 


5.  In  using  AREIS,  soldiers 

1.  Had  no  difficulty  with  words  or  ideas 

2.  Had  no  difficulty  with  words,  but  some  difficulty 
with  ideas 

3.  It  helped  soldiers  obtain  information  about  military 
and  civilian  education  options 

4-  Had  difficulty  with  both  words  and  ideas 
5.  I  don't  know 
No  Response 
Comment: 


N=16 
#  $ 

5  31 

1  6 

2  13 

4  25 

3  19 

J_  _ 6 

16  100$ 


6.  The  best  thing  about  AREIS  was  (more  than  one  answer) 

1.  The  machine  was  fun  to  work  with 

2.  It  helped  soldiers  relate  information  about 
themselves  with  military  and  civilian  career  options 

3.  It  helped  soldiers  obtain  information  about  military 
and  civilian  education  options 

4.  It  gave  soldiers  a  lot  of  information 

5.  It  was  objective  and  consistent 

6.  Al I  of  the  above 
No  Response 

Comment: 


N=37 
#  $ 

8  22 

i  1  30 

9  24 

6  16 

1  3 

2  5 

0  0 

37  100$ 


7.  The  worst  thing  about  AREIS  was  (more  than  one  answer) 

1.  The  machine  was  broken  too  much 

2.  There  wasn't  enough  information  that  soldiers 
wanted  to  know 

3.  There  was  too  much  content;  it  took  too  long  for 
soldiers  to  go  through;  it  was  confusing 

4.  Working  with  a  machine;  it  was  too  impersonal 

5.  Al I  of  the  above 
No  Response 

Comment: 


N=25 
#  $ 

9  36 

5  20 

9  36 

1  4 

0  0 

1  4 

25  lW 
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N=87 


8.  The  most  helpful  parts  of  AREIS  were  (select  as  many  as  you  wish) 

#  % 


1. 

Part 

One: 

Or ientation 

4 

5 

2. 

Part 

Two: 

Interests 

14 

16 

3. 

Part 

Two: 

Abi 1 iti es 

10 

1  1 

4. 

Part 

Two: 

Val ues 

9 

10 

5. 

Part 

Three: 

Getting  Promoted 

12 

14 

6. 

Part 

Three: 

Developing  Some  New  Interests 

4 

5 

7. 

Part 

Three: 

Getting  Some  Job  Skills 

5 

6 

8. 

Part 

Three: 

Completing  a  Next  Step  in  Education 

4 

5 

9. 

Part 

Three: 

Planning  a  Military  Career 

3 

3 

10. 

Part 

Three: 

Improving  MOS  Skills 

5 

6 

11. 

Part 

Three: 

Selecting  Another  MOS 

3 

3 

12. 

Part 

Three: 

Improving  Basic  Ski  i  Is 

3 

3 

13. 

Part 

Three: 

Deciding  about  Re-en 1 i stment 

4 

5 

14. 

Part 

Three: 

Making  a  Vocational  Choice 

7 

8 

No  Response 

0 

0 

Comment: 

87 

100$ 

9.  The 

1  east 

helpful 

parts  of  AREIS  were  (select  as  many  as 

you  wish)  N=34 

# 

% 

1. 

Part 

One: 

Or ientation 

5 

15 

2. 

Part 

Two: 

1 nterests 

1 

3 

3. 

Part 

Two: 

Abilities 

3 

9 

4. 

Part 

Two: 

Val ues 

2 

6 

5. 

Part 

Three: 

Getting  Promoted 

1 

3 

6. 

Part 

Three: 

Developing  Some  New  Interests 

3 

9 

7. 

Part 

Three: 

Getting  Some  Job  Skit  Is 

0 

0 

8. 

Part 

Three: 

Completing  a  Next  Step  in  Education 

2 

6 

9. 

Part 

Three: 

Planning  a  Military  Career 

2 

6 

10. 

Part 

Three: 

Improving  MOS  Skills 

2 

6 

1  1. 

Part 

Three: 

Selecting  Another  MOS 

4 

12 

12. 

Improving  Basic  Skills 

3 

9 

13. 

Deciding  about  Re-enlistment 

2 

6 

14. 

Part 

Three: 

Making  a  Vocational  Choice 

3 

9 

No  Response 

1 

3 

Comment: 

34 

102$* 

10.  What  is  your  general  reaction  to  providing  Information  to  soldiers  by 


computer  N=16 

#  % 

1.  Positive  9  56 

2.  Neutral  5  31 

3.  Negat i ve  17 

No  Response  1_  7 

Comment:  _ 16  1 0 T %* 


•Total  %  may  exceed  100$  due  to  rounding. 
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The  following  questions  relate  to  the  COUNSELOR/ADMIN) STHATQR  Subsystem. 


1  1 .  How 

accurate  is  the  information  in  the  COUNSELOR  Subsystem?  N 

=  16 

ft 

$ 

I. 

Very  accurate 

7 

13 

2. 

Moderately  accurate 

4 

25 

3. 

Undec ided 

2 

13 

4. 

Somewhat  inaccurate 

2 

13 

5. 

Very  inaccurate 

0 

0 

No  Response 

6 

37 

Comment : 

16 

101** 

12.  To 

what  extent  is  the  information  in 

the  CONSELOR  Subsystem  displayed 

in 

and  appropriate  format? 

N 

=  16 

§ 

$ 

i. 

Very  appropriate 

5 

31 

2. 

Moderately  appropriate 

1 

6 

3. 

Undec i ded 

2 

13 

4. 

Somewhat  inaccurate 

2 

13 

5. 

Very  inaccurate 

0 

0 

No  Response 

6 

37 

Commen  t : 

16 

100$ 

1 3.  How 

useful  is  the  information  in  the 

COUNSELOR  Subsystem?  N 

=  16 

# 

$ 

1. 

Very  useful 

3 

19 

2. 

Moderately  useful 

5 

31 

3. 

Undecided 

3 

19 

4. 

Not  very  useful 

0 

0 

5. 

Not  useful  at  all 

0 

0 

No  Response 

5 

31 

Comment: 

16 

100$ 

14.  How  is  the  content  of  your  interviews  with  soldiers  who  have  used  ARIES 
different  from  interviews  with  soldiers  who  have  not  used  AREIS? 


"Not  that  different,  just  about  everyone  made  printouts  and  would  sit 
down  and  discuss." 

"Eliminated  a  lot  of  things  they  needed  to  find." 

"There  was  not  any  Impact  tor  me  to  remember  the  ones  who  used  AREIS." 
"Time  was  a  problem." 
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"Didn't  have  to  go  thru  basic  information  on  Ed  Center  programs.  Could 
spend  an  hour  getting  to  a  goal.  Those  who  used  it  had  lots  of  directed 
questions  to  counselors." 

"Develops  more  desire  to  get  specifics  as  much  information  as  possible. 

"They  find  out  there  is  a  lot  more  information  than  they  thought." 

"Soldiers  already  had  an  idea  of  what  they  wanted  to  talk  about.  I  think 
they  set  their  goals  too  high."  "Not  different." 

"They  are  more  involved  and  more  goal  oriented." 

"Less  explanation,  merely  have  to  verify  for  them  what  they've  already 
learned  in  AREIS.  Better  understanding  of  what  they  want  to  do. .better 
mot  ivated." 

"Questions  more  formulated.  The  information  is  more  an  extension. 
Placement  of  computer  is  wrong." 

"More  directions  with  career  planning/goals.  They  are  aware  of  ACES 
programs  or  local  programs." 

"AREIS  a  reading  experience;  many  people  don't  value  that." 

"Don't  have  to  spend  time  giving  information.  Soldiers  know  where 
they  are  heading." 

"More  questions  from  those  who  used  AREIS-VEAP,  Ed  Benefits,  promotions." 

15.  How  has  your  role  of  counselor  changed  since  AREIS  has  been  in  the 
Education  Center? 

"Soldiers  get  goal  information  from  computers  -  we  did  real  planning. 

Much  more  to  the  point." 

"I  don't  think  it  has  changed.  Some  instances  AREIS  allowed  relief  from 
simplistic  information  giving." 

"Made  me  a  little  more  assured.  It  helped  me  a  lot." 

"Not  real ly  at  all." 

"Changed  somewhat.  I  did  not  include  computer  in  my  counseling.  Now  I 
do." 

"Didn't  really  change  it.  Location  near  the  desk  was  helpful." 
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"Added  to  my  time  schedule.  Hasn't  really  made  an  impact  on  my  role 
as  counselor." 

"Added  some  dimension  to  counseling.  It  was  a  chal lenge  tor  some." 
"Have  I  earned  technical  stuff." 

16.  What  kind  of  feedback  have  you  received  from  soldiers  about  their  AREIS 
exper ience? 

"Generally  positive  if  they  sat  through  it." 

"Haven't  gotten  too  much.  What  I  have  has  been  good." 

"Some  liked  playing  around  with  it." 

"Positive,  could  use  more  information  on  there.  Haven't  had  any 
negative  feedback,  except  program  should  be  more  indepth." 

"Disappointment  in  some  feedback  "It  was  okay"  don't  know  what  that 
meant.  1  out  of  4  would  come  back--others  no." 

"Negative/and  positive — it's  something  new/different/gives  good 
The  interests  part  really  peps  them  up." 

"Feedback  primarily  positive." 

"All  of  them  enjoyed  it — all  ranks,  officers,  enlisted,  etc. 

Thought  it  was  very  interesting." 

"Biggest  comments  -  they  enjoyed  using  it...  and  it  was  fun." 

"It  was  fun,  different.  Mostly  fun." 

"Some  frustration  in  some  places.  Fairly  positive,  otherwise." 
"Soldiers  really  liked  it.  Interested,  excited  with  it." 

"Positive  feedback--no  real  negative  feedback." 

"Mostly  positive  attitudes  about  it.  tspecially  liked  feedback  on  the 
set f- i nformation  section." 

"Very  little.  No  negative  feedback." 

"A  lot  thought  it  was  fun,  a  new  thing  to  try." 


74 


17.  what  changes  would  you  suggest  tor  the  ARE  I  S  Soldier  Subsystems? 

"Include  every  MOS.  Getting  Promoted -shou I d  be  a  screen  saying 
UNOFFICIAL  any  changes  prepared  as  of  a  certain  date.  Drop — Development 
of  New  Interests  altogether,  not  a  soldier  need.  Be  sure  that  the 
individual  knows  what's  happening." 

"Don't  care  for  it  much.  Amount  and  kind  of  information  has  to  be 
I imited ." 

"Values-a  lot  of  confusion  there." 

"Or i en tat i on--too  long.  Plan  New  Career-d i f f erent  for  each 

serv i cemember ,  Selection  of  MOS-give  guidelines,  procedures,  agencies  to 

he  I p. " 

"I  don't  know  that  I  would  make  any  changes  to  the  outline  or  the 
top i cs." 

"Requi rements  for  High  School  graduate." 

"Get  rid  of  ORI ENTAT lON-has  redundant  information,  because  they  have 
heard  it  in  inprocessing  or  from  a  brochure." 

"Doing  parts  are  always  better.  More  doing  with  feedback." 

"Make  it  easier  to  jump  around  in  the  system  to  back  and  front.  . 

Now  you  have  to  go  through  the  menu.  Get  soldier  into  interactive 
mode  sooner.  Expand  directions." 

"Instructions  moved  up  to  front.  Wouldn't  really  change  anything  other 
than  keep  it  current." 

"More  information  about  CLEP,  tailor  to  program  at  local  site." 

"Wor I d-of-Work  (WOW)  Map  could  be  clarified.  User's  Guide  could  have  WOW 
Map  in  it." 

"Material  very  comprehensive.  Sometimes  problem  with  backing  up. 

Rewrite  directions." 

18.  What  changes  would  you  suggest  for  the  AREIS  COUNSELOR/ADMINISTRATIVE 
System? 

"Gaps  in  MOS's  and  civilian  jobs.  Inservice  training  adequate." 

"I  don't  remember  enough  about  it  to  suggest  any  changes." 

"I  haven't  looked  at  it." 

"Data  on  school  schedules  put  into  system  need  to  be  expanded." 
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"Use  it  at  our  discretion.  No  basic  changes-covers  it  pretty 
well.  Right  now  can't  think  of  it." 

"None,  love  that  part.  Use  it  all  the  time  on  night  duty." 

"Can't  think  of  any!" 

"Soldiers  basic  data,  maybe  accounting  by  unit?" 

"No  comment,  not  familiar  enough  with  it!" 

"Love  the  printer.  Always  print  the  occupations  lists,  values,  etc." 

"All  the  information  is  good,  just  don't  get  a  chance  to  use  it  very  much." 
"Don't  know--haven' t  had  time  to  use  it  much." 
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APPENDIX  D 


definitions  of  acronyms  and  abbreviations 

BSEP  -  Basic  Skills  Education  Program 
T.A.  -  Tuition  Assistance 

COLLEGE  -  enrollment  i n  2  or  4  year  College 

BASIC  MATH/SCI  -  Basic  Mathematics  and  Science  courses 

OCS/ROTC  -  Officers'  Candidate  School,  Reserve  Officers'  Training  Corps 

ClEP  -  College  Level  Examination  Program 

APP  -  Army  Apprenticeship  Program 

GED  -  General  Educational  Development 

VA/VtAP  -  Veteran's  Educational  Benefits  Program 

ASVAB  -  Armed  Services  Vocational  Aptitude  Battery 

I NPROC'G  -  In-processing 

SOCAO  -  Service  members  Opportunity  Colleges  Associate  Degree 


77 


